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ROBUST  LINEAR  FILTERING  FOR  MULTIVARIABLE  STATIONARY  TIME  SERIES 


Haralampos  Tsaknakis  and  P.  Papantoni-Kazakos 
University  of  Connecticut 
U-157 

Storrs,  Connecticut  06268 


Abstract 

'  The  problem  of  asymptotic,  non-causal  linear  filtering  for  statistically 
contaminated  multivariable  stationary  time  series  is  considered.  The  spectra 
of  both  the  signal  and  the  noise  components  of  the  observation  process  are 
assumed  to  belong  to  certain  convex  and  compact  classes.  The  minimax  criterion 
of  optimality  is  adopted,  and  for  some  specific  spectral  classes  the  corres¬ 
ponding  solutions  are  found.  The  performance  of  those  solutions  is  studied, 
where  the  performance  criteria  used  are  efficiency,  error  variation  within  the 
classes,  and  breakdown  curves  or  points.  Some  examples  are  studied 


quant  lively. 


Research  supported  by  the  Air  Force  Office  of  Scientific  Research  under  Grant 
AFOSR-78-3695 . 


1.  Introduction 

We  consider  non-causal  filtering  for  stationary  information  processes  embedded 
in  additive  noise.  The  problem  and  its  solution  are  well  established  when  both 
the  information  and  noise  processes  are  statistically  well-known,  stationary,  and 
mutually  uncorrelated.  The  reader  may  refer  to  the  work  by  Kolmogorov  [4],  and 
to  the  books  by  Wiener  [9]  and  Hannan  [2],  Let  us  now  assume  that  the  information 
and  noise  processes  are  statistically  contaminated.  Then,  a  single  non-causal 
filter  is  sought  that  will  provide  satisfactory  performance  for  every  information 
process-noise  process  pair,  within  the  statistically  contaminated  classes.  If 
satisfactory  performance  Implies  qualitative  robustness,  then  a  nonlinear  opera¬ 
tion  on  the  data  of  the  information  process  should  be  in  general  imposed,  before 
transmission  through  the  noise  channel.  Such  a  stationary  nonlinear  operation  maps 
a  compact  class  of  stationary  processes  onto  another  compact  class  of  stationary 
processes.  If  the  nonlinear  operation  is  appropriately  designed,  a  linear  filter  will 
maintain  the  characteristics  of  qualitative  robustness.  For  qualitative  analysis  of 
the  above,  the  interested  reader  may  seek  reference  [6],  From  now  on  we  will  assume 
that  a  proper  nonlinear  operation  has  been  adopted,  and  we  will  concentrate  on  the 
stationary  processes  induced  by  this  operation  and  the  class  of  information  processes. 

We  will  name  those  induced  processes,  information  processes.  We  will  assume  that  the 
noise  process  lies  within  another  compact  class  of  stationary  processes,  and  that  the 
members  of  this  class  and  the  members  of  the  class  of  information  processes  are  mutually 
uncorrelated.  Then,  we  will  focus  on  the  design  of  a  robust  linear  filter,  adopting  a 
saddle  point  game  theoretic  approach.  We  point  out  here  that  the  same  approach  was 

adopted  in  [8],  where  noiseless  robust  prediction  and  interpolation  of  multivariable 
stationary  processes  was  considered.  Also,  considering  robust  linear  filtering  for 
scalar,  stationary  information  and  noise  processes,  the  interested  reader  may  seek 
references  [3]  and  [7]. 


In  the  present  paper,  we  consider  the  robust  linear  non-causal  filtering 
problem,  for  multivariable  stationary  information  and  noise  processes.  Ve  adopt 
asymptotic  linear  operations,  and  we  formulate  the  problem  as  a  game  with  saddle 
point  solution.  We  find  this  solution  explicitly,  when  the  information  and  noise 
processes  lie  within  either  one  of  two  compact  classes  of  multivariable  stationary 
processes.  One  of  the  compact  classes  represents  linear  contamination  of  a  nominal 
multivariable  process.  The  other  class  includes  multivariable  processes  with  fixed 
energy  on  prespecified  frequency  quantiles. 

The  organization  of  the  paper  is  as  follows.  In  section  2,  we  formulate  the 
problem,  and  we  define  the  compact  classes  of  multivariable  stationary  processes. 

In  section  3,  we  find  the  robust  solution,  when  the  compact  classes  for  the  infor¬ 
mation  and  the  noise  processes  both  represent  linear  contamination  of  a  nominal 
multivariable  process.  In  section  4,  we  find  the  robust  linear  filter  when  one  of 
the  compact  classes  represents  linear  contamination  of  a  nominal  multivariable 
process,  and  the  other  compact  class  includes  processes  with  fixed  energy  on  pre¬ 
specified  frequency  quantiles.  In  section  5,  we  find  the  robust  linear  filter, 
when  both  the  compact  classes  include  processes  with  fixed  energy  on  prespecified 
frequency  quantiles.  In  section  6,  we  present  some  criteria  for  the  performance 
evaluation  of  the  robust  filters  in  sections  3,  4,  and  5,  and  we  use  those  criteria 
to  study  the  performance  of  the  robust  filters  in  some  specific  examples. 
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2.  Problem  Formulation 

We  consider  the  asymptotic  non-causal  linear  filtering  problem  for  stationary 
multivariable  time  series,  when  the  statistical  structure  of  both  the  information 
and  the  noise  processes  is  vaguely  or  incompletely  specified.  We  assume  that  the 
noise  process  is  additive  to  the  information  process,  and  that  the  two  processes 
are  zero  mean  and  mutually  uncorrelated.  Let  Xn(j)  ;  j  =  ...,  -1,  0,  1,  ...  denote 


a  sequence  of  n-dimensional  data  vectors  from  the  multivariable  information  process. 
Let  Yn(j)  ;  j  =  ....  -1,  0,  1,...  denote  such  a  sequence  from  the  noise  process. 


Then,  the  observation  data  sequence  Zn(j)  ;  =  ...,  -1,  0,  1,  ...  is  such  that 
Zn(j)  =  Xn(j)  +  Yn(j)  ;  V  j,  and  the  noncausal  linear  filter  performs  the  operation 

OO 

/  a"  Zn(k)  to  extract  the  vector  Xn(0) ;  where  {A**}  is  some  sequence  of  constant 
k  k 

nxn  matrices  (whose  properties  will  be  stated  later),  such  that  in  the  frequency 

domain  the  matrix  polynomial  H  (to)  =  e-  exists,  and  it  describes  the 

~ 11  k=-“> 

linear  filter  uniquely.  In  the  parametric  linear  filter  problem,  the  information 


and  noise  processes  are  considered  well-known.  Then,  if  the  spectral  density  matrices 

of  both  those  processes  exist  (as  in  [8]),  and  they  are  denoted  respectively  by 

fn(to)  and  f”(to) ,  they  are  both  Hermitian  and  nonnegative  definite,  and  their 
— s  — N 

elements  are  Lebesque  integrable  functions  on  the  measurable  space  ([-IT, it],  B^)  ; 

where  8^  the  Borel  field  on  [-it, it].  If  the  asumptotic  non-causal  linear  filter 

signified  by  H  (to)  is  adopted,  and  the  mean  square  performance  criterion  is  con- 
— n 

sidered,  it  is  then  well-known  [2]  that  the  error  e(fn,  fn,  H  )  induced  is  given 

s  N  n 

by  the  following  expression. 

f*  T 

e(fn,l£,H  )=tr(2TT)~1  I  {[I  -H  (w)Jfn(to)[I  -H*(w)]T+H  (to)f%)H*  (w)}  du 
— s  — N  — n  I  n  — n  — s  n  — n  — n  — N  — n 

•'-*  (1) 


;  where  tr  means  trace,  *  and  T  signify  conjugate  and  transpose  respectively,  and 
I  is  the  nxn  identity  matrix. 
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From  expression  (1)  we  observe  that  the  mean  square  error  eCf^  H^)  is  only 
a  function  of  the  spectral  density  matrices  of  both  the  information  and  noise  processes, 
fj  Thus,  if  we  now  assume  that  the  statistical  structure  of  the  information  and  noise 
processes  is  incompletely  specified,  we  can  represent  this  incompleteness  solely  by 
uncertainty  in  the  description  of  the  spectral  density  matrices  f n(ui)  and  fn(o0  .  We 
I  will  formulate  our  approach  below.  We  will  also  drop  the  index  n,  for  simplicity  in 
our  notation. 

Let  the  spectral  density  matrix  f  (u>)  of  the  information  process  belong  to  a 

s 

«_  class  C^.  Let  the  spectral  density  matrix  f^(w)  of  the  noise  process  belong  to  a  class 

C  .  Let  the  members  of  each  class  be  Hermitian,  nonnegative  definite  matrices,  defined 
N 

on  the  interval  [-7T,tt],  containing  no  impulses  anywhere  on  [-ir,ir],  and  being  nonsingular 
for  all  b)£[-ir,Tr].  The  no  impulses  and  nonsingularity  restrictions  do  not  cause  serious 
S  loss  in  generality,  and  they  can  be  relaxed  if  necessary.  If  impulses  exist  at  a 

finite  number  of  points,  they  can  be  approximated  by  Gaussian  functions  with  arbitrarily 

i 

■  small  variances.  If  singularities  exist,  each  can  be  analyzed  separately  via  lower  rank 

matrices.  Let  be  the  class  of  linear  filters  whose  matrix  coefficients  {A,}  are  the 

f  k 

Laurent  series  expansion  coefficients  of  a  holomorphic  matrix  valued  function,  within 

P  an  annulus  containing  the  unit  circle  in  the  complex  plane.  Then,  each  member  {A^} 

in  S  is  uniquely  described  by  the  matrix  polynomial  H(w)  =  /]  A  e^^,  in  the 

S’  *  {^Too  k 

frequency  domain.  Let  us  consider  the  space  S  of  all  matrices  defined  on 
P  Then,  for  A(w)eS  and  B(w)eS  we  define  the  metric: 


d(A,B)  =  tr(2ir)‘ 


[A(u)-B(u)  ]  [A*(u>)-B*(w)  ]T  du> 


The  class  of  linear  filters  is  convex  and  locally  compact  with  respect  to 

the  metric  in  (2) .  We  will  consider  classes  C  and  C  that  are  also  convex  and 

S  fll 

locally  compact  with  respect  to  the  metric  in  (2).  Consider  now  a  game  on  (C^xC^) xS^, 
with  payoff  function  e(f  ,  f^,  H) ;  where  the  latter  is  the  error  expression  in  (1). 

S  N 
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The  game  has  a  saddle-point  solution  (f°,  f°,  H°) ,  where  f°  e  C  ,  f°  e  C  ,  and  H°  e  S„, 

— s  N  —  — s  s  — N  N  f 

iff: 

e<4,4,H°)  <  <  e(f°,fJ,H)  ;  V  H eSf,  VCf^)  e  CxC^  (3) 

If  a  saddle  point  solution  exists,  we  will  name  H°  the  robust  filter.  But  the  error 
function  e(f  ,  f_,,  H)  in  (1)  is  clearly  linear  with  respect  to  f  and  f„,  and  it  is 

— S  — N  —  — S  — N 

convex  with  respect  to  H.  Then,  a  saddle  point  solution  always  exists  [5].  Further¬ 
more,  if  (f°,  f°  H°)  is  such  a  solution,  then: 

e(f°,  i£»  5°)  =  lnf  SUP  e(f  ,  H)  = 

HeSf 


(4) 


(5) 


Then,  we  have  directly  from  [2]. 


en(ls,fN)  -  tr(2ir) 


f  (W)  U.  <“)+£*(«) 

— S  — S  — N 


f1  fjjCw) dw=tr(2ir)  j  [f^1(o))+f^1(oj)  ]-1c 

•'-TT 


attained  for  H(u)  =  f  (o))[f  (u))+f„(u>)  ]  ^  ;  for  almost  all  w  in 

— s  — s  w 

Thus,  for  the  solution  of  the  saddle-point  game,  it  is  equivalent  to  search  for  the 

supremum  of  the  expression  e  (f  ,  f  )  on  C  x  C  .  It  is  easily  observed  that 

m  s  - N  s  N 

e  (f  ,  f  )  is  concave  with  respect  to  both  f  and  f  . 
m  ~ s  — N  — s  — N 

As  in  [8],  we  will  considei  the  following  two  classes  of  spectral  density 
matrices  that  are  boti.  -u  ve:  and  locally  compact  with  respect  to  the  metric  in  (2) : 


s{f  (o>)  :  f  (oj)  =  (l-e)f  (<u)  +  e  h(w)  ;  w  e  [  — tt , tt J 
—  o 

;  where  £  given  and  such  that  :  0  <  e  <  1 

f  (to)  well-known  positive  definite  Hermitian  matrix 
~ o 

ti(uO  nonnegative  definite  Hermitian  matrix  satisfying  the  energy 
—1 

constraint:  (2tt)  tr  /  _h(to)dto  W;  for  given  W) 

■'-TT 

={f(w) :  tr  j"  f^(w)du)  =  c.  ;  i  =  l,...k,  tr  f  d to  =  c 

Jki  -Mr 


"  JAi  J-TT 

;  where  {A^}  measurable  disjoint  subsets  of  [-ir,n], 
k  k 

(J  ,  c  >  ^  cj  »  f.C10)  positive  definite  Hermitian  matrix} 

i=l  1  i=l  1 

Class  F  represents  linear  £ -contamination  of  a  nominal  spectral  density 
matrix  ^(to)  .  Class  F^  includes  spectral  density  matrices  whose  energy  is  fixed  within 
prespecified  frequency  quantiles-  Both  classes  satisfy  the  necessary  topological 
properties,  for  the  existence  of  a  solution  for  the  game  in  (3) .  In  the  subsequent 
sections,  we  will  find  the  solutions  of  the  game,  for  the  following  three  cases: 


i. 

C  = 

Ft 

and  C 

=  F 

s 

L,es 

N 

L 

ii. 

C  = 

ft  r 

and  C 

=  F 

s 

L,E 

N 

Q 

iii. 

C  = 

f„ 

and  C„ 

= 

s 

Q 

N 

Q 

3.  The  Game  Solution  on  F,  x  F, 

_ L,e  L.e 

In  the  present  section,  we  consider  the  case  where  C  =  F.  ;  with  energy 

S  t  ,Eg 

constraint  W  ,  and  C  =  F_  ;  with  energy  constraint  W„.  As  we  saw  in  section  2, 
s  N  L,£jj  N 

both  the  Cg  and  classes  are  then  convex  and  locally  compact  with  respect  to  the 
metric  in  (2) ,  and  then  the  game  reduces  to  obtaining  the  supremura  of  the  expression 
e  (f  ,  f  )  in  (6),  on  F  x  F  .  Let  f  (w)  and  f  „(u)  be  the  nominal  spectral 
densities  in  the  classes  F  and  F  respectively.  Let, 
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'  -  £ 
'  £ 


f  (<*))  doj  =  W 
—os  os 


f  (OJ)  dUl  =  W 
— oN  oN 


Then,  the  solution  of  the  game  on  F  x  F  reduces  to  the  following  optimization 

L»es  L»eN 

problem. 

Find  the  supremum  of 


tr  I  [-4 

J-n 


subject  to  the  constraints: 

f  (w)  -  (1-e  )  f  (w)  >  0 


— s 

s  —os 

-N^ 

f  (u>)  do)  < 
— s  — 

—IT 

“/ 

f  (w)  dw  < 
-N  - 

-TT 

OS  s  s  1 


i*.  /  n  i  c.  »»  j  —  m  _ 

N  oN  N  N  2 


;  where  if  B(w)  is  a  matrix  defined  on  £  — tt , tt ] ,  B(co)  0  means  nonnegative  definite 
for  all  w  in  [  — it , tt ] . 

The  expression  e^^f^,  f^)  in  the  optimization  problem  in  (3A)  involves  explicitly 

both  the  eigenfunctions  and  the  eigenvectors  of  the  spectral  densitiy  matrices  f  (u>) 

s 

and  f  (a)) ;  for  all  w  in  This  induces  complications  in  the  optimization  process. 

N 

Those  complications  can  be  resolved,  however.  In  particular,  we  will  first  derive  an 
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upper  bound  on  em^s»  L ^ »  c^at  involves  eigenfunctions  only.  Then,  we  will  find  the 
supremum  of  this  upper  bound,  and  we  will  show  that  this  supremum  is  attained  for  any 
eigenvectors.  To  formulate  our  approach,  we  will  first  present  a  lemma,  and  two 
corollaries.  We  will  then  apply  the  lemma  and  the  corollaries  to  the  problem  in  (3A) . 


Lemma 

Let  m  be  a  positive  measure  defined  on  a  measurable  space  ( fi,  F) .  Let  AeF,  and 
let  f,  g  be  two  real  functions  mapping  A  onto  the  real  line  R.  Let  f  and  g  be  also 
integrable  on  A  and  such  that  f+g  >  0,  a.e.  in  A.  Then, 


If-  dm  < 


ff  dm  .  f  g  dm 

ifi_  dm  <  4  a 

f+g  —  f  f  dm  +  f  g  do 

Ja  Ja 


with  equality  if  and  only  if  f  =  eg,  a.e.  in  A,  for  some  constant  c. 


Corollary  1 


For  any  real  numbers  x^,  y^  ;  i  =  l,...,n,  such  that  x.^  +  y.^  >  0;  Vi,  the  following 
inequality  holds. 


n 

£ 

Xi  yi 

n 

E 

< 1=1 

xi 

x.+y. 

~  n 

i=l 

i  i 

E 

i=l 

xi 

with  equality  iff 


Hi  =  fi 

yi  yJ 


;  v  i  *  j. 


The  proof  of  the  lemma  is  in  the  appendix.  The  result  in  corollary  1  follows  from 

n 

the  lemma,  the  definition  of  a  set  {A^}  such  that  A^fj =0;Vi^j,  (J  A^=A, 

n  n  j=l 

and  for  f  =  x^  1A  and  g  *  y^  1^  ;  where  1^  the  indicator  function  of  A^. 
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Corollary  2 

Let  A  and  B  be  two  nxn  Hermitian  and  positive  definite  constant  matrices.  Let 
{X±(A) ;  1  <  i  £  n}  and  (X^B)  ;  1  <  i  <  n}  be  the  sets  of  their  ordered  eigenvalues; 
that  is,  X^(A)  A^+^(A)  ant*  A^(B)  il  A^+^(B),  ^or  aH  Then,  the  following 

inequality  holds, 


tr  (A 


■  * 4± >.<■>]- 


;  with  equality  if  and  only  if  A  =  cB,  for  some  scalar  constant  c. 


The  proof  of  corollary  2  is  in  the  appendix,  and  it  evolves  from  the  lemma. 

We  will  now  apply  the  lemma  and  the  two  corollaries  to  the  optimization  problem 

(3A)  .  Let  us  consider  the  nxn  spectral  density  matrices  f  (to)  and  f  (to)  .  Since  both 

s  ~N 

the  nominal  spectral  density  matrices  f  (to)  and  f  (to)  in  (3A)  have  been  assumed 

— oa  ~oN 

positive  definite;  for  all  to  in  [-tt.tt],  and  due  to  the  nonnegative  definite  constraints 

in  (3A) ,  the  spectral  density  matrices  f  (to)  and  f  (to)  are  positive  definite  for  all  to 

— s  N 

in  [-71,11].  They  are  also  Hermitian.  Let  us  temporarily  fix  to,  and  let  us  denote  by 

{A.  (to);  1  <  i  <  n)  and  (A  (to);  1  <  i  <  n)  the  sets  of  ordered  eigenfunctions  for 
is  —  IN  —  — 

the  matrices  f  (to)  and  f(to)  respectively;  where  A^  (to)  >  A  ,  (to)  and  A,  (to)  >  X  .  (to) ;Vi 
'  s  — N  is  —  i+l,s  IN  —  i+l,N 

and  V  toe[-7i,Tr].  Then,  the  matrices  f^(to)  and  _f  (u)  are  also  Hermitian  and  positive  definite 

and  their  respective  sets  of  ordered  eignefunctions  are  {A71(to);  1  <  i  <  n}  and 

is  -  — 

(X7^(to);  1  <  i  <  n}  ;  with  X7*  (to)  >  A“1(to)  and  X  *  (to)  >  X7*(to),  for  all  i  and  all  to.  if 
lN  —  —  l+l,  s  ~  is  i+l,N  —  iN  * 

we  now  apply  corollary  2  to  the  spectral  density  matrices  f  (to)  and  f(to) ,  for  some 

s  — N 

fixed  to,  we  obtain: 


1  n  n 

«>>  +i>»"  4£*l6H  -1  +[£v“>l"1 ) 

'  1=1  J  Li=l  J  ' 


;  with  equality  iff  f  (to)  =  c(to)  •  f^  (w)  ,  for  some  scalar  c(to)  . 

S  N 


Directly  from  the  expression  e  (f  ,  f„)  in  (6)  and  from  (8),  we  now  obtain: 

m  — s  — n 


‘A-  i  (2”> 


'[  ([  E  +[E  XiN(“>]_1  )  d“ 


e  (f  ,  f„) 

j,  — s’  — N 


(9) 


;  where  if  f  (to)  =  c(to)  •  ;  V  toe[-TT,Tr],  for  some  scalar  function  c(to) 

defined  on  [-tt,tt],  then  equality  holds  above. 

We  will  now  transform  the  optimization  problem  (3A)  into  another  optimization 
problem,  that  involves  eigenfunctions  only.  To  do  that,  we  will  substitute  the  objec¬ 
tive  function  e  (f  ,  f  )  in  (3A),  by  its  upper  bound  e,(f  ,  f  )  in  (9).  We  will  also 
m  S  N  b  s  — N 

substitute  the  constraints  in  (3A)  by  constraints  that  involve  eigenfunctions  only. 

We  will  show  that  the  solution  of  the  transformed  problem  is  a  sufficient  solution  for 


the  problem  (3A) . 

Let  £_os(w)  and  f^(to)  be  the  nominal,  positive  definite  spectral  density  matrices 

in  the  classes  F  and  F  respectively.  Let  {A°  (to) ;  1  <  i  <  n}  be  the  set  of 
L’es  L,eN  is  -  ~ 

ordered  eigenfunctions  of  the  matrix  f  (to)  on  [-tt.tt].  Let  (A?  (to)  ;  1  <  i  <  n)  be  the 

-nos  iN  —  — 

ordered  eigenfunctions  of  f^N(to)  on  l— TT,1T] ;  where  A°g(to)  >_  A°+1  g(to);  V  i,  V  toe[-TT,Tr], 

and  A°^(to)  j>  A°+^  ^(to) ;  V  i,  V  <ue  [ -tt , it ] .  Let  f^(to)  be  a  spectral  density  matrix  that 

belongs  to  class  F  ,  and  let  {A  (to);  1  <  i  <  n}  be  the  set  of  ordered  eigenfunctions 
L,cg  is 

of  the  matrix  f  (to);  where  A.  (to)  >  A.  (to) ;  V  toe  l  — tt  ,  tt  ] ;  V  i.  Then,  the  matrix 
~~s  is  —  l+l 

f  (to)  -  (1-e  )f  (to)  is  nonnegative  definite  for  all  to  in  [-tt.tt)  which  induces  the 
— s  s  —os 

necessary  condition  A  (to)  (1-e  )  A°  (to);  V  toe[-TT,TT],  Vi.  A  necessary  and  sufficient 

IS  S  IS 

condition  that  the  matrix  f  (to)  must  satisfy,  so  that  the  matrix  f  (to)  -  (1-e  )  f  (to) 

— s  — s  s  os 

is  nonnegative  definite  V  ue  [ -tt , tt ] ,  will  involve  both  the  eigenfunctions  and  the  eigen¬ 
vectors  of  the  matrix  f  (to) .  A  sufficient  condition  for  the  satisfaction  of  the  latter 

— s 

is  given  by  the  inequality  A  (to)  >  (1-e  )  A°  (to);  V  toe  [— tt  ,tt]  .  Similarly,  if  f  (to)  is 

ns  —  s  is  — N 

a  positive  definite  matrix,  and  (A  (to)  ;  1  <  i  <  n)  is. the  set  of  its  ordered  eigen- 


1 1 


u. 


11 


functions,  it  is  sufficient  that  X^Cuj)  _>  (1-£N>  X°N(u)  ;  V  a)E[-Tr,Tr],  for  the  matrix 

f^Coi)  -  (l-eN)  f^N(u)  to  be  nonnegative  definite  for  all  w  in  [-it, it].  Through  the 

sufficient  conditions  Xng(a))  (l-£g)  X°s(a>) ;  V  a)£[-7r,rr]  and  X^Cu)  (1-E^)  X°N(u>)  ; 

V  0)e[-ir,Tr] ,  we  can  now  define  two  classes  F'  and  F'  that  are  contained  respectively 

s»es  N»eN 


in  F  and  F  . 
L»es  L»£N 


Those  two  new  classes  are  defined  as  follows. 


r 

S,es 


{f^Cw)  :  Xng(w)  _>  (l-£c)  X°e(w);  v  cue  [--rr.-rr]  and 


Is' 


tr 


f 

•'—IT 


f  (a))  da)  = 


.IT  n 

/  £ 

J-TT  i=l 


X.  (a))  da)  <  W, 
is  —  1 


(3B) 


;  where  {X°g(a))  ;  1  _<  i  £  n}  the  set  of  ordered  eigenfunctions  of  the 

nominal  spectral  density  matrix  f  (a))  in  F  ,  f  (cu)  a  positive 

“OS  L|£g  S 

definite  matrix  V  a)£[-ir,Tr]  and  {Xig(ai)  ;  1  i  _<  n}  the  set  of  its 
ordered  eigenfunctions}. 

FN  em  =  {-VU)  :  Ans(a>)  -  (1_eN)  XlN(a));  V  and 


tr 


vrr  /•‘tr  n 

I  £,,<»>  du.  -  2 

J-tt  •'-tr  i=l 


XiN(oj)  dat  <  W2 


(3C) 


;  where  {X°^(a))  ;  1  _<  i  £  n}  the  set  of  ordered  eigenfunctions  of  the 


nominal  spectral  density  matrix  f^Ca))  in  ,  f^(a))  a  positive 

definite  matrix  V  a)£[-tr,i 
ordered  eigenfunctions}. 


definite  matrix  V  a)£  [-tr.tr] ,  and  {X  (a>)  ;  1  <  i  <  n}  the  set  of  its 

lN 


The  positive  constants  VL  and  W,  in  the  classes  F'  and  F'  respectively,  are  the 

1  1  ® »£s  n»£N 

energy  constraints  in  the  optimization  problem  in  (3A) .  The  classes  P  and  F* 

s,£s  N,£N 

are  as  class  F  in  [8],  and  they  are  clearly  convex  and  locally  compact  with  respect 

to  the  metric  in  (2).  The  classes  F'  and  F’  are  nonempty  if  respectively 

s,£s  n»£N 


L 
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X,  (oj>  dco 

is 


r 

<_  W,  n  1(l-eg)  *  and  I  X° 

•'-TT 


°N(U1)  dw  <  W2  n_1(l-eN)"1. 


Let  us  state  the  following  optimization  problem  on  F'  x  F' 

s»es  N»eN 


Find  the  supremum  of 


-TT  n  -In 


i  ([2Xw]  +[Lv“>]  ) 

•  J-tt  L  i=l  L  i=l 


Subject  to  the  constraints: 


-  (1~es)  Xls(w)  »  V 

AnN(a,)  -  (1'S)  XlN(a))  J  V  <oe’t-ir»1rJ 


rv  n 

/  £ 

•Mr  i=l 

-TT  n 

/  £ 

•Mr  i=l 


X.  (w)  d(jJ  <  W, 
is  —  i 


X^tu)  dw  <  W2 


We  can  now  express  the  main  theorem  for  this  section.  Its  proof  is  in  the 


appendix. 


Theorem  A 


Let  the  classes  F  and  F..  of  spectral  density  matrices  be  such  that: 
L,Es  L»eN 


f  (w):  X?  (w)  dw  <  W.n^tl-e  )-1 

—os  is  —  1  s 


f  „(<•»:  J  X®  (w)  da)  <  W,n_1(l-e  )_1 
— oN  I  IN  —  2  N 


Then 


,  there  exists  a  sufficient  solution  {X®  (w)  ;  1  <  i  <  n>  and  {Xe  (w)  ;  1  <  i  <  n} 


is  '  -  -  iN' 

of  the  optimization  problem  (3D).  This  solution  also  provides  a  sufficient  solution 


6  6 

(f  (ut) ,  f (co) )  for  the  optimization  problem  (3A);  where  the  eigenvectors  of  the  matrices 

S  M 


6  6 

_f  ((*))  and  f  (to)  are  arbitrary,  and  it  is  such  that: 
S  h 


1.  If 


I  max(W11n(l-eg)X°s(a))  ,  W^nd-e^A^u))  dto  < 

*rr 


sN 


— TT 


Then, 


A*s(u>)  =  ’  V  i 


XiN(U,)  =  5  V  1 


;  where 


A*  (to)  =  A^(oj)  ;  V  toe[-TT,ir] 


I 


TT 


Ag(to)dto  =  n-1 


-TT 


2.  If 


r 

=  I  max(W11n(l-es)X°s(w)  ,  W^nCl-e^ 
•'-tt 


sN 


"O*  1N(U))  dW  >  1 


Then, 


Ai>)  =  A*(w)  ;  V  i 


XiN(W>  =  XN<W)  ;  V  i 


;  where 


A?  (to) 


xs(u>) 


A  i  a. 

y(l-£  )  A°  (w)  ;  uieE  =  {w:y  >(l-e  )(l-e  )-1  — -  } 

N  IN  y  —  s  N  \Ot..\ 


xIn(w) 


a  ,  A°  (to) 

(i-ej  A°  (w)  ;  weE*  ^  {u>:y  <(l-e  )  (l-e*,)"1  - 


(ID 


(A.l) 


(12) 


} 


(A.  2) 
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o  A  -1  Xin({4)> 

va-es)  x°  to)  ;  <^EV  s  {„=*  >  a-va-e.)  > 

\s(“> 

(l-eN)  X»N(U)  ;  weE'  4  {(B:v  <  ) 

Xls(“> 


|  V»(l-eN>  X°N(u)  dw  +  I  (l-£s)  X°g(w)  =  n”1  WL 

£  •'E0 

y  y 


vi 


|  v(i-es)  X°s(u)  dw  +  (l-eN)  \°  (w)  dw  =  n"1  w» 
E  JEC  ' 

V  V 


and  the  constants  y  and  v  are  both  positive  and  unique. 


The  robust  linear  filter  is  then  given  by:  He(w)  =  Xe(u>)  [Ae(w)  +  X®(a>)  ]  I;(i)c[-ir,'rr] , 

“  S  S  N 

where  I  the  identity  matrix. 


We  observe  from  theorem  A,  that  if  condition  (11)  holds,  then  any  information 

process  with  identical  spectral  ordered  eigenfunctions  X^(u)) »  and  any  noise  process 

with  identical  spectral  ordered  eigenfunctions  X*L(u))  =  W  X  W  Xe(u»)  ;  V  aie[-TT,ir] 

provide  a  sufficient  solution.  If,  on  the  other  hand,  condition  (12)  holds  instead, 

then  the  sufficient  solution  is  strictly  determined  by  the  maximum  eigenfunctions 

X?  (to)  and  X°  (to)  of  the  nominal  information  and  noise  processes.  Since  the  conditions 
Is  IN 

(11)  and  (12)  are  both  determined  by  the  interrelationship  between  the  eigenfunctions 
X°  (to)  and  X?  (to) ,  it  is  clear  that  in  all  cases  the  sufficient  solution  depends  on 
the  latter.  Solution  (A. 2)  is  graphically  exhibited  in  figure  1.  We  point  that  the 
solutions  in  theorem  A  are  not  unique.  They  are  sufficient,  however.  That  is,  any 


other  solution  can  not  be  superior,  performancewise. 
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4.  The  Game  Solution  on  F^£  x  F^ 

In  the  present  section,  we  consider  the  case  where  C  *»  FT  ;  with  energy 

s  L,es 

constraint  W  ,  and  C„  *  Frt.  The  case  C  =  F_  and  CM  =  Ft  is  symmetric  to  the 

S’  N  Q  S  Q  N  L,Ejj 

former;  thus  it  will  not  be  covered  explicitly.  As  in  section  3,  and  due  to  the  fact 

that  both  the  present  classes  Cg  and  are  convex  and  locally  compact  with  respect 

to  the  metric  in  (2),  the  game  reduces  again  to  obtaining  the  supremum  of  the  expression 

e  (f  ,  f  )  in  (6)  on  F,  x  F  .  Let  us  denote  W,  as  in  (3A),  and  let  {A  (to)}, 
m  — s  — N  L,eg  Q  1  is 

{A  (u>)},  be  the  ordered  eigenfunctions  for  the  information  and  noise  processes,  as 
IN 

in  section  3.  Let,  as  in  section  3,  {A°  (u) }  be  the  set  of  ordered  eigenfunctions  of 

is 


the  nominal  spectral  density  matrix  f  (w)  in  F„ 

—os  L,£s 

here  consists  of  finding  the  supremum: 


The  original  optimization  problem 


f  e  F. 


and  f  £  F„ 


e  (f  ,  fj 
m  — s  — N 


;  where  the  constraints  induced  by  the  class  F^  do  not  impose  any  restrictions 
on  the  eigenvectors. 

Parallel  to  the  optimization  problem  (3D)  in  section  3,  let  us  state  the  following 

optimization  problem  on  F1  x  F  that  involves  ordered  eigenfunctions  only;  where 

s,£s  ^ 

F'  _  as  in  section  3. 

s,-s 

Find  the  supremum  of 


•'-71  L  i-1  Ll-1  J 


V4-  4>  a  (21,) 


-1  n 


subject  to  the  constraints: 


A  (w)  >  (1-e  )  A,  (w)  ;  V  ue[-ir,TT) 
ns  —  s  Is 


»TT  n 

/  2 

•'-7T  i=l 


A.  (<*))  do)  <  W. 
Is  —  1 
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n 

I  £ 

Ja,  i=i 


A.„(to)  doj  =  c.  ;  j  *  0,...,k 
IN  j 


IS. 

;  where  AQ  =  [-*,*]  -  (J  Aj  ,  cQ  ^  c  -  ^  cj 


j=l 


j=l 


As  with  theorem  A  in  section  3,  we  can  now  express  the  following  main  theorem 
for  this  section.  Its  solution  is  in  the  appendix. 

Theorem  B 

Let  the  class  F  of  spectral  density  matrices  be  such  that: 

L,es 


c 

f  (to)  :  I  A?  (w)  dto  <  W  n-1(l-e  )-1 
— os  I  is  —  i  s 

«'-TT 


(14) 


Then,  there  exists  a  sufficient  solution  {\®s(tt)  ;  1  <_  i  <_  n}  and  {X^Oa)  ;  1  <  i  <_ 

of  the  optimization  problem  (4A) .  This  solution  also  provides  a  sufficient  solution 
6  0 

(f^w),  f^(u>))  for  the  optimization  problem  in  (13);  where  the  eigenvectors  of  the 
6  e 

matrices  f^(to)  and  f^(w)  are  arbitrary,  and  it  is  such  that: 

Ais(U))  =  AS(W)  ;  V  1 
AiN<W)  =  AN(U)  ;  V  i 


;  where 


A>>  -  2  o  (1-£s> 

3-0  Xj  J 


J-o  xj  j 


x °  =  /  (1-£d)  X°c(w)  dto  ;  j  =  0,...,k 

h3 


s'  'Is' 


(B.l) 
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r 

■■1/ 


yc^  ;  If  yc^  >_  x^ 


(1-e  )  A°  (co)  d£o  ;  if  yc*  <  x° 
s  is  j  j 


y  :  yc»  +  y]  xj  =  n_1  W.  ,  c*  -n”1  c. 

o  +  1 "  n  J  J 


3=w'>*° 


and  the  constant  y  is  positive  and  unique. 

The  robust  linear  filter  is  then  given  by:He(io)  =  Ae(w)  [  A 6(w)  +  A^(w)  ]  *  I;  uiel-lt  it] , 

S  S  N 

where  I  the  identity  matrix. 


In  theorem  B  above,  1  (co)  denotes  the  indicator  function  of  the  set  A  .  From 

i  .  1 

Ag(w) 

(B.l)  we  observe  that  the  sufficient  solution  is  such  that  the  ratio  -  is  piece- 


A*(w) 


wise  constant.  This  is  exhibited  graphically  in  figure  1.  As  in  theorem  A,  the 
solution  in  thorem  B  Is  controlled  by  the  maximum  eigenfunction  A°g(to)  of  the  nominal 
information  process.  The  solution  is  also  controlled  here  by  the  quantiles  and  the 
quantiled  energy  of  the  noise  process. 


5.  The  Game  Solution  on  Fn  x  F„ 


In  this  section,  we  will  consider  the  case  where  the  convex  and  locally  compact 
classes  of  information  and  noise  processes  are  both  F^,  with  different  quantile  and 
energy  characteristics.  Specif ically, denoting  Cg  =  F«  and  =  Fq  ,  we  define. 

F  ■  (f^w)  :  tr  /  lg(w)  dw  =  cgi  ;  i  =  1, . . .  ,k 

8  K±  (i5) 

S1  k 

;  where  {Ag^}  measurable  disjoint  subsets  of  u  Asl  -  t-’T."). 

f  (oo)  positive  definite  Herraitian  matrix}  *  * 


{f  (w)  :  tr  /  f_7(u>)  do)  =  c  ;  i  -  l,...,m 

N  I  N  NX 

;  where  {A^}  measurable  disjoint  subsets  of 
f^u>)  positive  definite  Hermitian  matrix} 


(16) 

m 

[-•*>"]»  {J  \ i  =  * 

i=l 


The  game  here  reduces  again  to  obtaining  the  supremum  of  expression  e  (f^,  f^)  in 
(6)  on  F  x  F  .  As  in  sections  3  and  4,  we  state  the  following  optimization  problem 
that  involves  ordered  eigenfunctions  only. 

Find  the  supremum  of 


eb<4’  1N)  =  W 


1  f  ([ixH'1  * 

•'-tt  i=l  i=l  J  / 


subject  to  the  constraints: 

n 


J[  xis(ul)  ^  *  cSj  ;  3  “  1»  •  • .  »h 

A  ,  i=l 
sj 


(5A) 


11 

I  XiN(U))  dU  =  cNj  ;  J  =  1 . m 

Kj  1=1 


;  where  the  sets  (A  {A  .}  are  given  by  the  classes  F  and  F  respectively. 

Nj  sj  QN  Qs 

We  now  proceed  with  the  main  theorem  in  this  section.  Its  proof  is  in  the 
appendix. 


Theorem  C 

Let  y(*)  denote  the  Lebesque  measure  in  [  — tt , tt ] .  Then,  a  sufficient  solution 

6  Q. 

(Xis(w)},  {X^n(oj)}  of  the  optimization  problem  (5A)  is  given  by  the  following 


expressions. 


;  j  =  i 


m,  and  arbitrary  otherwise 


;  where  A^  (to) 


/  V“>  *“  ' 
% 


Xe(M)  -  n 
s 


Z  sJZ  f  *>>  H 1  x>-h  .<“> 

J-l  L£-l  4jA  J 


A  special  solution  evolves  from  (C.l),  if: 


m 


n  CNi  ^  ^Aui^*1ANi^ 


and  then. 


(C.2) 


k  m 


!<u)  ■  -'VS  Z 


c  c  *1 
sj  Ni  A 


sj^  \i 


(to) 


m 


3'1  i'1  “<  v  Z  cn t  u<vn  v  v"1<v 

i=i 


;  where  l.(oo)  denotes  the  indicator  function  of  the  set  A. 

A 

A  sufficient  solution  for  the  original  optimization  problem  is  given  by  the 
ordered  eigenfunctions  as  in  (C.l)  or  (C.2),  and  arbitrary  eigenvectors.  The  robust 
linear  filter  is  then  given  by: 

He(oo)  =  Ae(w)  [ Ae(<o)  +  A®(oo)  ]  I;  toe  [ -tr , tt ] ,  where  I  the  identity  matrix. 

—  s  s  N 


From  theorem  C  we  observe  that  one  of  the  eigenfunction  sets  (information  or 
noise  process)  may  be  selected  arbitrarily,  but  satisfying  the  corresponding  quantiled 
energy  constraints.  Then,  the  remaining  eigenfunction  set  is  determined  uniquely.  A 
particular  such  selection  is  given  by  (C.2).  Then,  A  (to)  is  a  piecewise  constant 
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function  on  the  {A^}  quantiles,  and  A®(ui)  is  a  piecewise  constant  function  on  the 

{A  A  }  quantiles.  Solution  (C.2)  is  exhibited  graphically  in  figure  1.  In  the 
si  Nj 

special  case  that  k  =  m  and  A  .  =  A  ;  V  j,  the  solution  (C.l)  gives  A  (a))  = 
k  sj  Nj  s 

Ec  .  c  1  1.  (to)  *  A®(to) ,  while  the  solution  (C.2)  corresponds  to  Ae(to)  and  A®(to) 
.  si  N1  A  .  N  s  N 

J=i  sj 

that  are  both  piecewise  constant  functions  on  the  {A  }  =  {A  .}  quantiles,  at 

sj  Nj 

different  levels. 


i 

I 


6.  Performance  Evaluation  -  Examples 

In  this  section,  we  will  discuss  the  performance  induced  by  the  robust  linear 
filters  in  sections  3,  4,  and  5.  We  will  also  present  quantitative  results  for  some 
examples . 

The  solutions  in  theorems  A,  B,  and  C  provide  the  "worst"  pair  (f  (to),  f  (to))  of 

— s  — N 

information  and  noise  spectral  density  matrices  (in  terms  of  performance)  within  the 

corresponding  C  and  C  classes,  and  they  are  all  such  that  Ae  (to)  =  A e(w) ;  V  i, 
s  N  is  s 

0  0 

AiN(w)  =  An(o>);  V  i.  Therefore,  if  I  is  the  identity  matrix,  the  spectral  density 
6  6 

matrices  f  (to)  and  f„(to)  are  given  by  the  following  expressions. 

S  N 


fe(w)  =  Ae(w)-I  ;  we[-Tr,7r] 

s  s 

f®(w)  =  A®(w)-I  ;  we[-TT,Tr] 

—N  N 


(17) 


If  H)  denotes  the  error  induced  by  the  spectral  density  matrices  fg,  f^, 

and  the  linear  filter  H,  and  if  H  denotes  the  robust  linear  filter  on  C  x  C„,  then 
in  all  three  cases  represented  by  theorems  A,  B,  and  C,  we  have: 


He(u>) 


®(4’  4’ 


=  A®(u>)  [A*(w)  +  A®(u>)  ]_1  • 

He)  <  e(f®,  f®,  He)  ;  V(f  , 
S  N  s 


I  ;  u)e[-TT,Tr] 


4> 


e  Co  x  CM 

s  N 


(18) 

(19) 


(  2tt)  — 1 


A®(w)  -A®(o))  [A ®(u)  +  A®(u)  ]  du 


(20) 


u 
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;  where  I  is  the  identity  matrix,  expression  (20)  is  obtained  by  substituting 
expressions  (17)  in  (6),  and  in  (20)  the  dimensionality  of  the  multivariable  processes 
has  been  assumed  equal  to  n.  If  we  substitute  expression  (18)  in  expression  (1),  we 


g  6 

obtain  the  mismatch  error  e(f  ,  f  ,  H  )  induced  by  the  robust  lienar  filter  H  and 

s  — N  —  — 


some  pair  (f  ,  f  )  of  spectral  density  matrices  in  C  x  C  .  The  mismatch  error  is 
— s  — N  s  N 


then  given  by  the  following  expression. 

.IT 


e<4,  4*  H  )  = 


He)  =  (2TT)"1  I  [A%)+A*(w)  r2{[X®(u>)  ]2^Xis(u))+U®((,')  ;2  £1^(0)  }dw 

•'-TT  i  i 


;  (f  ,  4)  £  C  x  C 
— s  s  N 


(21) 


;  where  (X.  (to) }  and  (X.„(w)}  the  ordered  eigenfunctions  of  f  (w)  and  f „  (a)) 
is  in  — s  — N 

respectively. 


Let  f  and  f  be  two  nominal  spectral  density  matrices  in  classes  C  and  C„ 
—os  — oN  J  s  N 

e 

respectively.  Let  H  be  the  robust  linear  filter.  Then,  for  all  the  classes  in 

0 

sections  3,  4,  and  5,  the  mismatch  error  e(4s»  J^N*  —  )  is  given  by  expression  (21), 

if  the  spectral  density  matrices  f  and  f  are  substituted  respectively  by  f  and 

— s  — N  —os 

f  .  Due  to  expression  (6),  the  optimal  error  e(f  ,  f  )  at  (f  ,  f  )  is  given  by 
-'oh  —os  — oN  —os  ~ oN  0 

the  following  expression. 


e(f  , 
—os 


(27T) 


-1 


tr 


f 

•'-IT 


[f  1(w) 
—os 


+  f"i(w) ] 

— oN 


-1 


du 


(22) 


Given  the  classes  Cg  and  C^,  given  nominal  spectral  density  matrices  4S  ant* 

0 

f  ;  in  C  and  C  respectively,  given  the  robust  linear  filter  H  in  C  x  C  ,  we 
“~oN  s  N  s  N 

0 

will  define  two  performance  measures  for  the  filter  H  .  The  efficiency 

E(He,  f  ,  f  ,  C  ,  C  )  of  the  filter  H6  at  some  pair  (f  ,  f  )  in  C  x  C  is  defined  as 
—  — s  — b  s  N  —  — s  — N  s  N 

the  ratio  of  the  optimal  error  e(£  ,  f  )  in  (22) ,  over  the  mismatch  error  e(f  ,  f  ,  H6 

— s  —H  — s  — N  — 

in  (21).  That  is, 
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E(He,  V4.  Cs,  CN)  4  e  (4,  4)  .  e'1^,  4,  H*) 


For  given  filter  H®,  the  efficiency  of  He  in  C  x  C  ,  clearly  attains  its  highest 
—  s  N 

6  6 

value,  one,  at  (j^,  f^)  .  If  nominal  spectral  density  matrices  f^g  and  _f^N  are  given, 

an  interesting  measure  is  the  efficiency  of  the  filter  I!  at  (fog,  f^)  . 

e 

Given  the  robust  filter  II  ,  let  us  define, 

e(CS’  cn*  ^e>  "  inf  e(4»  4*  ^8)  (24) 

s  N  (f  ,f)eC  xC  “■  ^ 

— s  — N  s  N 

;  where  for  any  of  the  classes  Cg,  in  sections  3,  4,  and  5,  the  error 
e(f^,  f^,  S6)  is  given  by  (21). 

Then,  we  define  a  second  performance  measure  for  the  robust  filter  H®,  in 

6  G 

sections  3,  4,  and  5.  The  performance  variation  P(H  ,  C  ,  C  )  of  the  filter  II  in 

s  rj 

C8  x  CN  is  defined  as  the  ratio  the  error  e(Cg,  C  ,  H.  )  in  (24)  over  the  error 
e(fC,  f®,  He)  in  (20).  That  is, 

p(H6.  Cm,  CN)  &  e(Cg,  CN,  H®)  •  e"1^,  fj,  H®)  (25) 

The  performance  variation  clearly  does  not  exceed  one  (due  to  (19)), and  it  measures 
the  maximum  error  variation  induced  by  the  robust  linear  filter  H®  in  C  x  C„. 

—  S  N 

0 

The  infimum  represented  by  the  error  e(C  ,  C  ,  H  )  in  (24)  exists  for  compact 
classes  Cg  and  C^,  and  it  can  be  computed  explicitly  for  the  cases  studied  in 
sections  3,  4,  and  5.  We  state  this  result  in  a  theorem,  whose  proof  is  in  the 
appendix. 

Theorem  1 

The  error  e(Cg,  C^,  He)  in  (24)  is  given  respectively  by  the  following  expressions. 

a.  C  x  C„  »  F.  x  F.  in  Section  3 

s  N  L,es  L,eN _ 

If  condition  (11)  in  theorem  A  is  satisfied,  then. 


e<Cs*  V  il  )  =  eCig.  H  )  =  (2ir)  W2  (Wx  + 


;  v(f  ,  fN)  e  F  X  F 
-s  -N  L,es  L,eN 


If  condition  (12)  in  theorem  A  is  satisfied,  then. 


*«V  C„.  I6)  -  = 


2  2 
V  u 

s  .2  s  N  ,,  .2  N 

(l+v)  (l+y) 


+  (2TT)"1  (1-e  ) 

s 


it  ,e/\  ^  n 

r  r_  — ]  v 


i  r  r  xe(u)>  -|  “ 

+  (  2tt)  1  (1-e  )  - § - —  V 

LU>)+x>^  h 


X  (w)  dw 
is 


A  (w)  dw 

iN 


;  where  W  ,  W  the  energy  constraints  in  classes  F  and  F  respectively,  and 

8  N  L»£s  L»eN 

U,  V,  A*(ui) ,  \e(o>)  as  in  solution  (A. 2)  in  theorem  A. 
c*  S 

b.  C  x  C  =  F  x  F_  in  Section  4 

s  N  L,eg  Q 


•«v  CH-  a*)  ■  £  {At)  f  z 

j=0  '  J  J  •'a  1=1 


A.  (w)  da) 
Is 


+  (27T) 


tfer) 


+  Cs  1  + 


,  -1, 1  -1 

n.max  (x.  c  )  W 

j  1  1  J 


;  where  W  the  energy  constraint  in  class  FT  ,  (c1 '  }  the  energy  levels  in  class  F  .times  n 

8  L,»es  J  Q 

and  (x. }  ,  (x. },  y,  as  in  theorem  B. 


*  * 
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c.  C  x  C  =  F  xF  in  Section  5 
s  N  Q  Q 


e(C  ,  C,  He)  =  (2ir) 

3  N  — 


_1  1  +  - 

m 

L  v 


sr-J 


cn£  Asj^  n£ ) 


(2tt)  1  c  •  min 

ti  ^sjny« 


r  m 

i  +  c-1  y 

sj  L-j 

L  1=1 


CN l  Asi^ 


|j‘1(ak£)] 


;  where  all  the  quantities  in  expression  (29)  are  as  in  theorem  C. 


In  theorem  1  above,  it  has  been  assumed  that  in  cases  a.  and  b.,  the  energy 

levels  W  and  W  are  fixed. 
a  N 

From  expressions  (A. 32),  (A. 38),  and  (A. 42)  in  the  appendix, the  solutions  (A. 2), 
(B.l),  and  (C.2)  in  theorems  A,  B,  and  C  respectively,  and  by  direct  substitution  in 
expression  (20),  we  also  find. 


1.  Case  in  theorem  A.  Condition  (12)  satisfied 


e(f^,  M.e)  =  C2tt)  *  n  j(l-eN)uU+y] 


‘I, 


XiN(oj)  dto  + 


+  (1-e  )v[l+v] 

S 


A-  (to)  doj  + 
is 


*Cc  0EC 

v  '  vi 


(1~£S)(1  CN)Xls(^)XlN(a})  dcj| 

U-€sUL(“Ha-€HUts(“)  ’ 


;  where  all  the  quantities  in  (30)  are  as  in  theorem  A. 
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Case  in  theorem  B. 


•<£•  4-  ae) 


(2’)'1 »  £c5  Icj  +  xjrl 

j-0 


;  where  all  the  quantities  in  (31)  are  as  in  theorem  B. 


3.  Case  in  theorem  C.  Solution  (C.2) 


e(f®,fJ,He)  =  (2Tr) 


.  -1 
m  k  r  m  -| 

’Y  cNi^~ Y  1+c8j  Y  Asj)U'1(Altf>  'j(AKi'1  v 

i=l  j=l  L  £= 1  J 


;  where  all  the  quantities  in  (32)  are  as  in  theorem  C. 

Finally,  for  the  robust  filter  He  in  sections  3  and  4,  we  can  evaluate  respectively 

e 

a  breakdown  curve  and  a  breakdown  point.  The  breakdown  curve  for  the  robust  filter  II 

*  *  *  * 
in  section  3  is  the  set  of  points  (£g,  e^)  such  that,  if  either  one  of  the  Eg,  en 

values  increases,  then  the  error  induced  by  H6  at  any  pair  (fg,  fjj)  in  £  x 

can  take  arbitrarily  large  values.  The  pairs  (£g,  Tor  which  that  occurs  are 

those  that  satisfy  condition  (11) .  Indeed,  expression  (26)  is  then  satisfied,  and 

the  error  e(C  ,  C  ,  He)  increases  then  monotonically  with  the  signal-to-noise  ratio 
s  N 

W,  The  breakdown  point  for  the  robust  filter  He  in  section  4  is  this  value  £ 

1  2  r  —  8 

above  which  the  error  induced  by  He  at  any  pair  (f  ,  f  )  in  F  x  F  can  be 

arbitrarily  large.  The  values  £g  for  which  that  occurs  are  such  that  x^  ~  ;  Vj 

in  the  solution  of  theorem  B.  Indeed,  by  substitution  in  (21),  we  easily  find  that 

then  the  error  e(C  ,  C  ,  He)  is  as  in  (26).  The  condition  x,  =  y  c*  ;  V  j  provides, 
s  N  j  j 

in  general,  a  lower  and  an  upper  bound  on  £g.  The  upper  bound  e*  is  the  breakdown 
point.  The  lower  bound  eg^,  Tn  conjuction  with  the  lower  bound  eg^  provided  by 
condition  (14),  determine  acceptable  £g  regions,  for  which  the  solution  in  theorem  B 
holds.  Directly  from  (14)  and  (3A),  we  obtain: 


e'T  =  U  +  2tt  W 
sL  I  s 


IJL‘ 


X  (w)dw  -  2tt  W 


J  1 


From  the  condition  x^  =  JJ  c^  ;  V  j,  and  from  the  quantities  in  (B.l),  we  obtain 


after  some  simple  computations. 


e  T  =  min 
sL  meS 


(K-(t-;)l  ■ 

1  '  1=0  J  J A. 


Xls(“)d“  2Tr(Wos-Ws) 


k  -1 

fe  cj)  f  n  d“]  ) 

j=0  '  Jk  ' 


;  where 


’■‘I1 


k  -1 


XT  (w)  dw  <  2tt(W 
Is  os 


-v  [Ecj’ 

L  -i 


e  =  max 
meS, 


(m 


nX,  (w)dw-2nW 
Is  os 


i(M 


nX,  (w)dw-2Tr(W 
Is  os 


-"s’] 


Hn  X°  (w)  dw  >  2ir  W  f  'V''  c*  1  j 

ls  °sl£o  3J  i 


The  acceptable  c  region  for  the  case  in  theorem  B  is  then  [max(c  ,e'),e*]. 

s  sL  sL  s 

If  class  S  in  (35)  is  empty,  then  e  =  0.  If  class  S  in  (37)  is  empty,  then 
1  sL  2 

e*  -  1. 
s 

The  breakdown  curve  induced  by  the  robust  linear  filter  H  in  section  3  is  of 
particular  interest,  and  it  will  be  studied  here  analytically.  As  we  will  see,  this 
curve  behaves  as  the  capacity  region  in  information  theoretic,  two-user  multiplexing. 
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Let,  as  in  theorem  A,  n  be  the  dimensionality  of  the  vector  information  and  noise 

processes,  let  X°  (w)  and  X°  (to)  be  the  maximum  nominal  eigenfunctions  for  the 
Is  IN 

information  and  noise  processes  respectively,  let  Wqs  and  be  the  energies  of 

the  nominal  information  and  noise  processes,  and  let  W  and  W  signify  the  energies 

s  N 

of  the  contaminating  information  and  noise  processes  respectively.  Let  us  define. 


g(w)  =  X°g(w)  t*°N(w)]  ;  to  e[-ir,7r] 


TT  TT 

D  =  [  J  «  XiNM  dU)][|*  n 


X.  (w)  doj 
lsv 


TT 

AN  ™  J  n  X°g(u»  dtoj  •  max  (min  g(w),  (2tt)  2  D) 


,  A  ..  .2 
Ag  =  <2*) 


IT 

n  X°N(ui)  dwj*max  (min 


5  1(to),  (2tt)"2  D  *) 


bn  "  1  +  27r  wn  (An  *  2*  ^nJ"1 


B  -  Jl  +  2ir  W  (A  -  2ir  W  I-1 

SI  S  S  os 


We  can  now  state  the  following  theorem,  whose  proof  is  in  the  appendix. 


Theorem  2 

Let  the  function  g(io)  *  X°^(w)  (^1N^U^  ^  be  cont*nuous  everywhere  in  [-tt,it]. 
Wherever  differentiable,  let  the  derivative  of  g(to)  be  zero  or  infinity  only  on  an  U) 
set  of  measure  zero.  Then,  the  breakdown  curve  for  the  classes  in  theorem  A  is 
strictly  concave,  the  acceptable  (e  ,  e  )  region  lies  within  the  subplane  [Bs,  l]x[B  ,  1] 

3  K  9ew 

where  the  numbers  B  ,  B„  are  given  by  (38),  and  the  derivatives  — - 

8  M  9e  e  -  1,  3e  e„  -  1 

Ns  s  N 

are  both  zero. 
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The  breakdown  curve,  and  the  acceptable  region  are  exhibited  in  figure  2.  If 

the  function  g(U))  in  theorem  2  has  zero  and/or  infinity  derivatives  on  nonzero  measure 

|  w  sets,  then  the  breakdown  curve  will  still  be  monotone,  but  it  will  not  be  strictly 

concave.  We  observe  that  the  quantities  A.,  -  2ir  W  „  and  A  -  2n  W  in  (38)  are 
. .  N  oN  s  os 

-r.  both  nonnegative,  and  they  are  strictly  controlled  by  the  nominal  information  and 

P  noise  processes.  If  both  those  quantities  are  strictly  positive,  the  lower  limits 

and  in  the  acceptable  region  decrease  monotonically  as  the  contaminating 

energies  W  and  W  respectively  increase.  The  limits  B„,  and  B  become  zero  for  any 
Ns  Ns 

W„,  W  values,  if  respectively  A  -  2tt  W  „  =  0  and  A  -  2tt  W  =  0.  This,  for  example, 
—  Ns  N  oN  s  os  _  _ 


-2  2 

occurs  if  (2ir)  max  g(o))  D  >  (2tt)  min  g(w),  and 
ir  w  tt  n  W 


nXlN(U>)dW 


f  E 

J-ir  i=l 


nX,  (co)  dio 
Is 


ir  n 

f  2 

J-7T  i=l 


Xu  (co)dco, 
is 


X  (co)dio;  where  g(to)  and  D  are  given  by  expressions 
iN 


(38).  The  above  conditions  reflect  the  case  where  the  nominal  ordered  eigenfunctions 
(for  both  the  information  and  noise  processes)  are  equal  to  each  other.  We  finally 
note  that  the  lower  boundaries  Bg  and  B^  in  the  acceptable  region  of  figure  2  are 
results  of  the  conditions  (10)  in  theorem  A.  Those  conditions  were  imposed  so  that 
the  robust  solution  is  independent  of  spectral  eigenvectors. 

We  will  complete  this  section  by  presenting  and  quantitatively  analyzing  some 
examples.  We  will  present  examples  for  the  two,  more  interesting,  cases  in  sections 
3,  and  4.  We  will  base  our  quantitative  analysis  on  the  performance  measures  introduced 
in  this  section. 

a.  Example  for  Case  in  Section  3 

Let  the  nominal  Information  and  noise  vector  processes  have  dimensionality  two. 


>  We  select. 
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Als(w) 


f  (w) 

os 


X°  (u») 

2s 


aJn(“) 


I  M<w) 

oN 


X°N(W) 


;  where 

o  2  o  -1 

A^g(oo)  =  ag[l  +  2  cos  to  +  a^] 

X°  (w)  =  a2[l  +  2  a.  cos  a)  +  a2] 

2s  S  2  2 

-1  (40) 

X1N(U)  "  aN[1  +  2  Sj_  cos  u  +  32] 

x°N(w)  -  <j2[i  +  2  e2  cos  u  + 

We  also  select  Wg  WQg  *=  1  and  W^  WQ^  =  1.  Increased  Wg  WQg  and  W^  WQJ  values  will 
give  uniformly  inferior  performance  for  any  pair  (E  ,  e  ).  Decreased  such  values  will 

S  JN 

give  uniformly  superior  performance,  instead.  In  expressions  (40),  we  select, 

a2  -  5  X  10-2 

8  (41) 

°N  -  I"’2 

We  also  select. 


“l  -  ct2  "  *98 


hm  *2  ~-93 


The  above  example  corresponds  to  the  case  of  equal  eigenfunctions  for  both  the 


noise  and  information  nominal  spectral  density  matrices.  Thus,  the  acceptable  region 

of  figure  2  is  here  such  that  B  =  B  =  0.  Computed  points  of  the  breakdown  curve 

s  N 

are  given  by  table  1  below. 


e 

s 

o 

• 

S 

.95 

.16 

.25 

.34 

.46 

.58 

• 

o 

.79 

.85 

.91 

.97 

.79 

.70 

.61 

.49 

.37 

.25 

.16 

.10 

.07 

.01 

Table  1 

Breakdown  Curve  for  Example  ( 39 ) — (42 ) 


For  the  example  stated  by  expressions  (39)-(42),  we  computed  for  various  (e  ,  £  ) 

S  N 

values,  the  efficiency  E(He,  f?  ,  _f  ,  C  ,  Cv)  at  the  nominal  pair  (f  ,  f  ) ,  the 

peformance  variation  P(He,  C  ,  C  ),  and  the  error  e(fe,  ff„,  H6).  We  also  computed  the 

S  N  S  N 

error  variation  induced  by  the  optimal  filter  H°  at  (fos,  f^) ,  within  the  class  Cg  x  C 
We  denote  this  error  variation  P(H°,  Cs,  CN>,  and  we  define  it  as  the  ratio  of 

min  e(f  ,  _f  ,  H°)  over  max  e(f  ,  f  ,  H°).  We  exhibit  our  results 


in  tables  2,  3,  4,  and  5  respectively.  In  table  6,  we  exhibit  values  for  the  quantity 
max  e(£jj»  In’  — °*  ° 


(4’VeCsrfN 


.002 

.01 

.986 

.985 

.174 

.173 

.109 

.109 

.097 

.096 

.091 

.091 

.09 

.09 

.089 

.088 

.15  .2  .3 


.5  .6 


.9  .95 


972 

.959 

.941 

.893 

.832 

.761 

.677 

.578 

.457 

.381 

.292 

163 

.158 

.152 

.141 

.131 

.120 

.110 

.101 

.091 

.087 

.083 

106 

.104 

.102 

.098 

.094 

.091 

.087 

.083 

.083 

.083 

.083 

095 

.093 

.092 

.089 

.086 

.083 

.083 

.083 

.083 

.083 

.083 

090 

.088 

.087 

.083 

.083 

.083 

.083 

.083 

.083 

.083 

.083 

087 

.085 

.083 

.083 

.083 

.083 

.083 

.083 

.083 

.083 

.083 

083 

.083 

.083 

.083 

.083 

.083 

.083 

.083 

.083 

.083 

.083 

E 


i\eN 

It.  \ 

3  \ 

.002 

.01 

* 

o 

Ln 

.1 

.15 

.2 

.3 

.4 

.5 

.6 

.7 

.8 

.85 

.9 

.95 

^002 

5 _ 

.733 

.680 

.503 

.378 

.302 

.252 

.190 

.156 

.135 

.124 

.123 

.139 

.164 

.219 

.375 

I-1 

.682 

.681 

.675 

.671 

.670 

.672 

.684 

.706 

.738 

.782 

.840 

.914 

.958 

1.00 

1.00 

;*.3 

f _ 

.852 

.852 

.851 

.852 

.856 

.860 

.876 

.897 

.926 

.962 

1.00 

1.00 

1.00 

1.00 

1.00 

.903 

.903 

.903 

.906 

.912 

.919 

.940 

.968 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

.927 

.928 

.930 

.937 

.948 

.963 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

.8 

.935 

.936 

.941 

.955 

.977 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

.9 

.942 

.943 

.960 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

Table  3 

PQi6,  C  C  )  for  Example  (39)-(42) 


i 


& 

.002 

.01 

.05 

■ 

.15 

.2 

.3 

■ 

.5 

.6 

■ 

.8 

.85 

.9 

.95 

.101 

.109 

.145 

.189 

.233 

.277 

.365 

.449 

.532 

.613 

.692 

.768 

.803 

.837 

.866 

.617 

.621 

.641 

.666 

.689 

.712 

.753 

.789 

.821 

.846 

.865 

.877 

.879 

.880 

.880 

•:.3 

.789 

.791 

.801 

.813 

.824 

.834 

.850 

.864 

.873 

.879 

.880 

.880 

.880 

.880 

.880 

.5 

.839 

.840 

.846 

.854 

.860 

.866 

.874 

.879 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.7 

1 - 

.862 

.863 

.868 

.873 

.876 

.879 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

(.8 

.870 

.871 

.875 

.878 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

t J _ 

.876 

.877 

.879 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

.880 

Table  4 


e(f^,  1n»  for  Example  (39)- (42) 


.Vn 

.002 

.01 

.05 

■ 

.15 

.2 

.3 

.4 

.5 

.6 

■ 

.8 

LTJ 

00 

.9 

.95 

|002 

J _ 

.797 

.764 

.633 

.525 

.451 

.398 

.325 

.278 

.245 

.221 

.202 

.188 

.181 

.176 

.170 

l .1 

.077 

.077 

.077 

.077 

.076 

.076 

.075 

.074 

.074 

.073 

.072 

.072 

.072 

.071 

.071 

f;3 _ 

.028 

.028 

.028 

.028 

.029 

.029 

.030 

.030 

.031 

.031 

.032 

.032 

.032 

.033 

.033 

■  5 

.017 

.017 

.017 

.018 

.018 

.018 

.019 

.019 

.020 

.020 

.020 

.021 

.021 

.021 

.022 

l> 

.013 

.013 

.013 

.013 

.013 

.013 

.014 

.014 

.015 

.015 

.015 

.016 

.016 

.016 

.016 

-8 

1  . 

.011 

.011 

.011 

.011 

.012 

.012 

.012 

.013 

.013 

.013 

.014 

.014 

.014 

.014 

.014 

1-9 

.010 

.010 

.010 

.010 

.010 

.011 

.011 

.011 

.012 

.012 

.012 

.013 

.013 

.013 

.013 

Table  5 


P(H°,  Cg,  CN)  for  Example  (39)-(42) 
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p  o 

We  note  that  large  P(H  ,  Cg,  CN)  and  P(H  ,  Cg,  CN>  values  correspond  to  small 

6  O 

error  deviations  within  C  x  C  ,  as  induced  by  the  filters  H  and  H  respectively. 

From  tables  3  and  4,  we  observe  that,  for  large  values  of  the  pair  (e  ,  e  ),  the  error 

S  N 

deviation  within  C  x  C  is  small,  but  it  deviates  around  absolutely  large  values  of 
s  N 

6  6  6 

the  maximum  error  e(f^,  H  )•  From  table  2  and  4,  we  observe  that  the  efficiency 

6  6  6 

at  the  nominal  pair  (f  ,  f  ) ,  and  the  maximum  error  e(f  ,  f  ,  H  )  both  degradate 

OS  ON  s  N 

gracefully  as  the  values  of  the  pair  (e  ,  £„)  increase.  The  values  .083,  1,00,  and 

s  N 

.880  in  tables  2,  3,  and  4  respectively  correspond  to  values  (e  ,  £  )  that  are  beyond 

s  N 

the  acceptable  region;  that  is,  beyond  the  breakdown  curve.  Comparing  tables  3  and 
4,  with  tables  5  and  6,  we  observe  the  truly  dramatic  effect  of  the  robust  filter  II  . 
Indeed,  from  tables  5  and  6  we  see  clearly  that  if  the  presence  of  the  contamination 
is  ignored,  and  the  optimal  at  the  nominals  filter  is  adopted,  then  the  error  fluctua¬ 
tion  as  well  as  the  maximum  error  in  C  x  C  are  dramatically  large,  as  compared  to 

s  N 

those  induced  by  the  robust  filter.  This  is  so,  even  for  small  contamination  para¬ 
meters  e  and  £  .  Thus,  the  results  of  the  comparison  between  tables  3  and  4,  and 

S  N 

5  and  6  speak  for  themselves,  and  those  results  are  the  true  advocates  In  favor  of 
the  robust  approach. 

In  figure  3,  we  have  plotted  the  efficiency  E(H  ,f  ,f  ,C,C),  the  maximum 

—  “os  “oN  s  N 

6  6  6  6 
error  e(^  ,  f„,  H  ),  and  the  performance  variation  P(H  ,  C  ,  C  ),  for  the  example  (39)- 
s  N  s  N 

(42),  as  functions  of  £  .  for  £  =  .1  and  E  =  .7.  We  notice  that  for  both  e  *  .1 

N  s  s  s 

and  eg  °  .7,  the  performance  variation  induced  by  the  robust  filter  maintains  uniformly 

6  6  6 

high  values,  but  so  does  the  maximum  induced  error  e(f  ,  II  ).  Thus  the  error 

5  N 

0 

induced  by  H  fluctuates  relatively  a  little  within  C  x  C__,  but  it  does  so  around 
—  s  N 

6  6  6 

relatively  large  error  values.  At  £g  =  .1,  the  maximum  error  e(f&,  _f  ,  H  )  is  more 

than  25  percent  less  of  the  same  error  at  E  =  .7,  for  £„  values  not  exceeding  .01. 

s  N 

6 

The  maximum  gain  in  performance  variation  P(H  ,  C  ,  C  ),  as  one  moves  from  e  *»  .1 

—  s  N  s 

to  £  *  . 7  is  about  33  percent,  realized  at  about  £  =  .18.  The  gain  in  efficiency 

S  N 
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E(H6,  f  ,  Cs»  y.  as  one  moves  from  £g  =  .7  to  £g  =  .1,  reduces  monotonically 

as  Ejj  increases.  The  maximum  such  gain  exceeds  8  percent.  We  note  that  the  regions 
in  figure  3,  within  which  the  curves  (2),  (3),  and  (4)  converge  to  the  respective  values 
.083,  1.00,  and  .880,  signify  points  beyond  the  breakdown  curve.  In  figure  3,  we  have 
also  plotted  the  performance  variation  P(H°,  C  ,  C__),  for  e  =  .1.  We  observe  how 

—  S  N  S 

0 

dramatically  smaller  than  P(H  ,  C  ,  C  )  this  variation  is.  This  fact,  in  conjuction 

s  w 

with  the  off-scale  values  of  the  maximum  error  e(H°)  exhibits  nicely  the  superiority  of 

e  o 

the  robust  filter  H  ,  as  compared  to  the  optimal  at  (f  ,  f  „)  filter  H  .  At  e  =  .7, 

—  —os  — oN  —  s 

this  superiority  is  far  more  striking,  and  it  is  deleted  from  figure  3. 

We  point  out  that  if,  in  our  example,  we  select  the  nominal  eigenfunctions  in 

(40)  such  that  (to)  j4  (to)  and  A°  (to)  J  (to)  ,  the  performance  induced  but  the 
Is  2s  IN  2N 

0 

robust  filter  will  deteriorate  uniformly.  This  deterioration  will  be  increasing, 
as  the  distance  between  the  corresponding  eigenfunctions  increases. 


b.  Example  for  Case  in  Section  4 


Let  the  vector  information  and  noise  processes  have  dimensionality  two.  We 
select,  as  with  the  example  for  section  3, 


i  («o)  = 
os 


\°  (<o)  =  A°  (co)  =  ct2[1  +  2  a  cos  to  +  a2] 
Is  2s  s 


-1 


a -  5  x  10 


-2 


(43) 


s 

a 


=  .98 


W  =  W 
s  os 


Then,  £gL  in  (33)  is  equal  to  zero,  and  the  class  in  ^35)  is  empty.  Thus, 

max  (e'T ,  e  _ )  **  0. 
sL  sL 

Let  us  select  a  nominal  spectral  density  f  (w)  in  the  class  F^.  We  need  this. 

— oN  Q  * 

to  evaluate  performance  measures  P(H°,  Cg,  CN>  and  e(H°),  as  with  the  example  for  the 
case  in  section  3.  Let  f  „(u))  be  such  that, 

ON 


f  >> 

oN 


X?N<“> 


X>> 


^1N^  =  *2N^  =  +  2  B  cos  0)  +  B2] 


-1 


2N 


(44) 


<4  '  10‘2 


3  -  -.93 


We  select  the  quantiles  (A^ ;  0  <  j  _<  k)  in 
(j+l)TT(k+l)  "*■).  The  energy  level  c^  in  is  then 


such  that, 
equal  to 


[jTT(k+l)  1, 
2X°(a))  do). 


where  ^°N(W)  is  given  by  (44).  We  select  k+1  values  equal  to  2,  4,  10 
As  in  the  example  for  the  case  in  section  3,  we  compute  for  various  e 

s 

quantities  E(He,  f^,  f^,  Cg,  CJ ,  P(He,  Cg,  CJ ,  e(f®,  f®,  H®) ,  P(H° 
e(H°).  Our  results  are  exhibited  respectively  in  tables  7,  8,  9,  10, 
for  all  cases  the  class  S  in  (37)  is  empty,  thus  £* 


,  20,  and  30. 

values  the 

,  C  ,  C  ) ,  and 
s  N 

and  11;  where 


=  1. 


\e 

k+lX^ 

.002 

- - 

.01 

.02 

.1 

.2 

.3 

■ 

.5 

.6 

.7 

.8 

.9 

2 

.643 

.568 

.453 

.173 

.124 

.109 

.101 

.096 

.093 

.091 

.090 

.088 

4 

.895 

.733 

.528 

.173 

.125 

.109 

.101 

.097 

.094 

.092 

.090 

.089 

10 

.970 

.759 

.537 

.174 

.125 

.109 

.101 

.097 

.094 

.092 

.090 

.089 

20 

.977 

.766 

.533 

.174 

.125 

.109 

.101 

.097 

.094 

.092 

.090 

- 

.089 

30 

.981 

.778 

.550 

.178 

.126 

.110 

.102 

.097 

.094 

.092 

.090 

.089 

Table  7 

E(He,  fQg,  ^oN»  Cg,  CN)  for  Example  (43)-(44) 


\e 

k+lH^ 

.002 

.01 

.02 

.1 

.2 

.3 

.4 

.5 

.6 

.7 

.8 

.9 

2 

.818 

.565 

.515 

.686 

.799 

.853 

00 

00 

• 

.904 

.919 

.929 

.938 

.946 

4 

.743 

.480 

.459 

.685 

.798 

.852 

.883 

.903 

.917 

.928 

.936 

.943 

jiO 

.719 

.468 

.454 

.683 

.798 

.852 

.883 

.903 

.917 

.927 

.936 

.942 

J20 

.719 

.464 

.454 

.638 

.798 

.852 

.883 

.903 

.917 

.927 

.935 

.942 

130 _ 

.724 

.467 

.452 

.676 

.793 

.848 

.879 

.900 

.914 

.925 

.933 

.940 

Table  8 

P(He,  C  ,  C  )  for  Example  (43) -(44) 

—  S  N 


tj 

.002 

.01 

.02 

.1 

.2 

.3 

.4 

.5 

.6 

.7 

.8 

.9 

2 

.139 

.227 

.313 

.618 

.737 

.790 

.821 

.840 

.854 

.864 

.871 

.877 

4 

.110 

.208 

.301 

.617 

.736 

.789 

.819 

.838 

.852 

.862 

.870 

.876 

10 

.105 

.206 

.299 

.616 

.735 

.789 

.819 

.838 

.852 

.862 

.870 

.876 

20 

.104 

.205 

.299 

.  616 

.735 

.  789 

.819 

.838 

.852 

.862 

.870 

.876 

30 

.103 

.201 

.294 

.609 

.730 

.784 

.815 

.835 

.849 

.860 

.868 

.874 

Table  9 

e(fe,  f®,  H6)  for  Example  (43)-(44) 
S  N 


.002 

.01 

.02 

.1 

.2 

.3 

■ 

.5 

.6 

.7 

.8 

.9 

2 

.075 

.072 

.069 

.049 

.035 

.026 

.020 

.016 

.012 

.010 

.008 

.006 

4 

.227 

.208 

.188 

.104 

.064 

.044 

.033 

.025 

.019 

.015 

.012 

.010 

10 

.670 

.543 

.438 

.167 

.090 

.059 

.042 

.032 

.025 

.020 

.016 

.013 

20 

.812 

.639 

.504 

.181 

.096 

.063 

.045 

.034 

.027 

.021 

.017 

.014 

1 30 

.853 

.672 

.530 

.191 

.102 

.067 

.048 

.036 

.029 

.023 

.018 

.015 

Table  10 

P(H°,  C  ,  C  )  for  Example  (43)-(44) 

—  S  N 


■  lc+1 

.002 

.01 

.02 

.1 

.2 

.3 

■ 

.5 

.6 

.7 

.8 

.9 

j2 _ | 

.684 

.706 

.735 

.960 

1.242 

1.525 

1.807 

2.089 

2.371 

2.653 

2.935 

3.217 

i  4 

.262 

.285 

.313 

.538 

.821 

1.103 

1.385 

1.667 

1.949 

2.231 

2.513 

2.795 

JlO 

.099 

.121 

.149 

.375 

.657 

.939 

1.221 

1.503 

1.786 

2.068 

2.350 

2.632 

'-20 

.085 

.108 

.136 

.362 

.  644 

.926 

1.208 

1.490 

1.772 

2.054 

2.336 

2.619 

m _ 

.082 

.104 

.131 

.349 

.621 

.893 

1.165 

1.437 

RRS1 

1.982 

2.254 

2.526 

Table  11 

e(jJ°)  for  Example  (43)-(44) 


From  tables  7,  8,  and  9,  we  observe  that  the  number  of  the  quantiles  affects  the 

6 

performance  induced  by  the  robust  filter  H  ,  only  for  e  values  below  .02.  Then,  the 

s 

performance  improves  as  the  number  of  the  quantiles  increases,  with  highest  effect  on 

g 

the  efficiency  E(H  ,  f  ,  f  ,  C  ,  C  )  and  for  £  <  .01.  The  reason  for  this  behavior 

—  — os  — oN  s  N  s 

is  that,  the  more  accurate  representation  of  the  noise  spectral  density  matrix  f^N 

resulting  from  the  increased  number  of  quantiles,  drives  the  robust  filter  He  close 

to  H°,  only  for  small  contamination  £  .  For  relatively  large  such  contamination,  the 

s 


39 


accuracy  in  the  representation  of  has  little  effect  on  the  design  of  the  robust 

|  filter  H®.  Comparing  tables  8  and  9,  with  tables  10  and  11,  we  see  again  the  striking 

effect  of  the  robust  filter,  as  compared  to  the  optimal  at  the  nominals  (f  ,  f  ) 

—os  — oN 

filter,  H°. 


a 

•  y 

a 


(2) :  Efficiency  from  Table  2. 

(3) :  Performance  Variation  from  Table  3. 

(4) :  Maximum  Error  from  Table  4. 

(5) :  Performance  Variation  from  Table  5. 


Solid  Lines:  e  =.l 
s 

Dashed  Lines:  t  =.7 
s 

Figure  3 

Performance  Curves.  Example  (39) -(42) 
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A.l 


Appendix 

Proof  of  the  Lemma 

Define  the  set  A  =  {x  :  x  e  A,  g(x)  >  0}.  If  f  +  g  >  0,  a. e.  in  A,  then  f  >  0, 
S 

a.e.  in  A  -  A  .  Define, 
g 

Pg(B)  -  J  g  dm  ;  BCAg 
•'B 


y.(B)  =  f  dm  ;  B  dl  [A-A  ] 
f  g 


4>  (X)  =  X[l+X]-1  ;  X  £[-!,“) 


(A.l) 


The  measures  yg  and  y^  in  (A.l)  are  positive  measures,  and  the  function  <j>  is 
clearly  concave.  We  now  write. 


dm 

f+g 


=  /  g  *  (j)  dm  +  f  f  •  <J>  (-|)  dm  = 

\  Jk~k& 

"  /  0  (f )  d  Mg  +  ^  (f)  d  Pf 

■'A 


(A. 2) 


Since  the  function  <J>  is  concave,  we  apply  Jensen's  inequality  in  (A. 2),  and 


we  obtain: 


[  In  dm-  W  f  I d  yg) 

A  \ 

+  yf(A-Ag).<(>(yg1(A-Ag)  f  f  d  yf) 

Ja-a 


lu(A-A  ) 


M  (A  )  +  f  —dp 

p,(a-a  )  +  / 

8  g  /  g  g 

f  8  J 

*A 

i- 

g 

/  gdm  •  /  fdm 

/  gdm  .  / 

•/v  A 

A-a  A- 

with  equality  in  all  parts  iff  f  =  eg;  a.e.  in  A 
./  * 

The  proof  of  the  lemma  is  now  complete. 

Proof  of  Corollary  2 

Let  A^(A) ,  A_^(B),  A^(A  +  B  ),  i  =  1 . n  be  the  ordered  eigenvalues  of  A,  B 

and  A-1  +  B-1  respectively.  Let  {a.,  i=l,...n}  ,  {b  , i=l, . . .n} ,  { c  ,  i=l,...n}  be 

1  1  X 

the  associated  orthonormal  sets  of  eigenvectors  of  A,  B  and  A-^  +  B-1.  Then,  we  can 


write: 


A'1  -  A)  a±  a*1 

i=l 

B-1  -  h  if 


^  V*"1*6"1)  "  h.  c*T(A~X+B_1)c, 


/  j  n  T  n  T  (A. 4) 

i-1  Y.  X,-1(A)(c*  a,.)2  +  y  A^BXc*  b£)2 


The  relationships 


V  k,  V  i 


1  ;  V  k,  V  i 


and  the  convexity  of  the  last  expression  in  (A. 4)  with  respect  to  X^  (A),  X^  (B) 
yield: 


n  *T  .  2  *T  2 


n  n  £  ^  V 

“1.  J 


k=l  £= 1  Ak  (A)  +  Xl  (B) 


(A.  5) 


If  we  apply  the  lemma  for 


n  n 


f  -  Z)  Z  va> 


k=l  £=1 


n  n 


vb>  1 


k=l  £=1 


and  positive  measure  m(»)  such  that 


n 


T  2  .T  2 


m(A 


k£ 


E*1  £  *x 

(Cf  ak)  (c±  b^) 


i=l 

n  n 


;  where  {A^,}  any  sets:  ^  A^  =  A,  A^  mutually  exclusive.we  obtain: 


A  A 


n  *T  2  *T  2 


y'  y  -1  ^  v 
h.  w  \1<A> +  v1® 


4(£t\“S^v'<4\>') 

L'k=l  1=1  i=l  ' 


^  *T  2  *T  2V"1 


'  k=l  t= 1  i=l 


f] 


=  ^(trA)'1 


+  (trB) 


From  (A. A),  (A. 5),  and  (A. 6)  we  conclude  the  desired  result. 


(A.  6) 


Proof  of  Theorem  A 

We  will  present  the  proof  in  two  parts.  In  part  1,  we  will  prove  that  (A.l) 
and  (A. 2)  are  sufficient  solutions  for  the  optimization  problem  (3D),  and  that  they 
satisfy  the  supremum  of  e  (f  ,  f  )  on  F’  x  F'  .  In  part  2,  we  will  prove  that 

ID  S  N  8  jtg 

a  solution  on  F’  .  x  F'  is  sufficient  for  the  optimization  problem  on  F.  „  x  FT 

s,fcs  w,eN  L>es  b,eN 

Part  1 


Let  us  define: 


V">  -  "_1  E  *!.<“> 


s.<“>  -  "'1 E 


(A.  7) 


From  (A- 9)  and  (A. 10)  we  clearly  conclude  the  sufficiency  of  the  solution  (A.l) 


in  theorem  A,  for  the  optimization  problem  (3D). 


2.  Let  condition  (12)  hold.  Considering  the  functions  in  (A. 7),  and  the  objective 
function  eb(f^,  f^)  in  the  optimization  problem  (3D),  we  have  due  to  the  lemma: 


(2it)  eb<4> 


Vi"  f 

■'-71 


X  (w)-X  (to)  [X  (to)  +  X  (<o)]  dto 

s  N  s  N 


(A. 11) 


On  the  other  hand,  for  the  admissible  eigenfunctions  {X^  (to) }  and  (X^„(to)}  in 

is  IN 


solution  (A. 2),  we  have: 


(2tt)  eb(f^ 


;,  fp  =  n  I  X*(to).X^((o)  [X*(co)  +  X^to)]"1  dto 

•'—'TT 


(A. 12) 


We  will  prove  that  for  any  admissible  functions  Xs(<o)  ,  >N(to)  ,  as  in  (A. 7),  we 


X  (to)  X  (to)  [X  (to)  +  X. 

s  N  s 


,N(a>)  ]  1  dto  <  I 

■'-TT 


Xe(w)  X*(to)  [Xe(to)  +  X^to)]"1  dto  (A. 13) 

s  N  s  N 


We  first  observe  that  due  to  the  condition  in  (12),  the  sufficient  solution  in 
(A. 2)  is  such  that: 


Vi  <  W^  wr  V  <  W"1  w2  -  p  V  <  1 


(A. 14) 


Due  to  (A. 14)  we  also  conclude  that  the  sets  E^,  in  (A. 2)  are  such  that: 


Enn^-» 


(A. 15) 


E  CL  Ec  E  C.  Ec 
cyc_*  v»  cv  y 


(A. 16) 


(A.  15)  is  true,  because  if  not,  there  would  exist  some  to  in  E^f"\  E^  such  that 

-1  X1<,(W)  -1 

y  >  (l-e_)(l-e  )  -  and  v  >  (1-e  )(l-e  )  -  which  contradicts  (A. 14) 


(A. 16)  follows  from  (A. 15).  Due  to  (A. 15)  and  (A. 16),  we  conclude  that  the  interval 


can  be  subdivided  into  the  three  disjoint  and  exhaustive  sets  E  .  E  .  E®  A  E 

y  v  y  '  ’ 


K  Finally,  from  the  solution  in  (A. 2),  and  the  constraints  in  (3D),  we  clearly  obtain 

that  for  any  admissible  functions  A  (to)  and  A  (to),  as  in  (A. 7),  we  have: 

s  N 


A  (to)  -  A®(to)  >  0  ;  V  we  E® 
s  s  y 

Ajj(io)  -  A®(to)  >  0  ;  ¥  loe  Ej 


(A. 17) 


We  now  concentrate  on  the  proof  of  (A. 13).  Due  to  (A. 14)  -  (A. 16),  we  easily 
obtain: 


f 

-IT 


A  (to)  A  (to)  [A  (to)  +  A 

s  N  s 


N(<*>)  r1  du  - 

•’-‘IT 


A  (oj)  A®  (to)  [Ae(to)  +  A® (to)]-1  du  = 

s  N  s  N 


|  [As(to)-\^(to) ]  [AN(to)-A^(to) ]+y^(l+y)  V-e^A^to)  [AN(to)-A*(w)  ]+(y+l)-i(l-e;N)A°N(to)  [As(to)-A*(to)  ] 
|  (y+l)(l-eN)  A°N(to)  +  [As(to)  -  A® (to)  ]  +  [AN(to)  -  A®(to) ] 


[As(to)-A®(to)][AN(to)_  A® (to)]  + 


[(1"£s)Xls(a,)  ]2tAM(a,)-Av(a,)  ]  U-eM)A?M(to)  ]2[Ao(to)-A®(to)  ] 


N 


N 


(1-e  )A°  (to)+(l-e)A°  (a» 
S  Is  N  IN 


.  r”ir _ 

(1-es)A®s(to)+(1-eN)A°N(a») 


'■:C  A  Ec 

y  '  *  v 


(1~es)Xls(a,)  +  (1-eN)  XlN(w)  +  [Xs(u)  "  Xs(a))1  +  lXN(W)  '  XN(a))1 


f  [As(to)-A®(to)][AN(to)-A®(to)]+(v+l)-1(l-es)A°s(to) [AN(w)-A®(to)]+v2(v+l)  1(l-eg) A®s(to) [As(to)-A®(w) ] 
i  (v+l)(l-eN)A°s(to)  +  [As(to)-A®(w)]  +  [AN(to)-A®(to)] 


(A. 18) 


Considering  expression  (A. 18),  we  now  make  the  following  observations 


A. 8 


An(u»)  -  An(c o)  >  0  ;  V  toe  E^ 

yv  <  1  ^  y2(y+l)~2  <  (v+l)"2  -  y2(y+l)-1(l-eN)  A°N(to)  [XN(w)-  Ajj(to) ]  < 

<  (\H-l)“2(y+l)(l-eN)  X°N (to)  [XN(w)-Xjj(w)]  ;  V  ue  Ey 

A  (to)  -  Ae(to)  >  0  ;  V  toe  E  • 
s  s  —  v 

yv  <  1  ->  v2(v+l)"‘‘  <  (y+l)“z  vz(v+l)-i(l-e  )  A°  (to)  [A  (to)-  Ae(to)]  < 

s  Is  s  s 

<  (y+l)~2(v+l) (1-e  )  A°  (to)  [A  (to)-Ae(to)]  ;  v  toe  E 

s  Is  s  s  v 


An(oj)  -  A*(w)  >  0  ,  Ag(to)  -  A*(co)  >  0 
<1-Cs,xia<“)  >  >,(1-es)  >BM  •  Xw<“)  > 


;  »  ue  E'nEC  » 
*  y 1 1  v 


(A. 19) 


[  (l-es)  A;s((0)  ] 1  [AN(co)-Ag(g))  ] 
(1-£s)Xls(a,)  +  (1“eNUlN(a)) 


[1~£N)XlN(a))l2[Xs(tu)-Xs(t,3)] 
(1-es)Xls(a,)  +  C1-EnKn(u) 


<  (v+l)_1(l-es)Ajs((o)  [AN(to)  -  A*(w)]  < 

<  (v+l)“2[(l-e  )A°  (<o)+(l-e  )  A°  (to)  ]  [A  (to) -A*" (to)  ] 

S  Is  N  IN  N  N 

;  V  toe  Ec  fl  E° 
y  v 


<  (y+l)-1(l-e  ) A°  (w)  [A  (to)  -  Ae(to)  ]  < 

N  IN  s  s 

<  (P+1)  '2  [  (l-Es)X°s(l»)+(l-e||)X°1|(u.)  ]  [As(a>)  -A'ta)  ] 


:  *  <*  ES  n  ej 


To  simplify  our  notation,  we  eliminate  the  integration  variable  to,  and  we  denote 


X  Xs  Xs’  y  **  XN-XN’  Z1  =  ^+1^1-eVXiN 


z.  =  (v+1) (1-e  )A°  ,  z  S  (1-e  )A°  +  (l-e)A° 

2  s  Is  3  s  Is  N  IN 


;  V  to 


(A. 20) 


f 


In  view  of  the  conditions  in  (A. 19)  and  the  notation  in  (A. 20),  we  obtain  from 
l): 


f*  -1  f"  e  e  e  e  -1  f  **  *  (v+1)"2  7  + 

vn>w  -  — tttt 

J  -TT  J-V  JF  -1 


(y+1)  2  X  z, 


.  / 

Ec  f\  Ec 
y '  >  v 


-2  -2 
xy+(V+l)  y  z3+(y+l)  x  z3 

x+y+z 


/- 


(v+1)  2y  z2  +  (y+1)  2x  z, 
x+y+z 


(A. 21) 


We  observe  that  all  the  integrands  in  the  upper  bound  in  (A. 21)  have  the  form: 


f  (w^,  w2,  w3)  = 


A  wi  w2  +  (v+1)~2  w2  w3  +  (V+1)  2  wx  w3 


W1  +  w2  +  w3 


(A. 22) 


The  function  f(w^,  w2,  w3)  above  is  concave  in  the  region  determined  by 
Wf  +  w2  +  w3  >  0,  and  w3  >  0  ;  for  all  V  and  y  such  that  y  V  <  1.  Therefore,  if  ft 
is  some  o)  set  such  that  the  above  conditions  for  concavity  hold,  (where  w^,  w3 
functions  of  id)  an  application  of  Jensen's  inequality  results  in  the  following  expression 


L 


f  (w. 


w„ 


w3) 


da) 


1  f(/ v  /  "27„  7 

■'n  •'ft 


(A. 23) 


Considering  now  the 


functions  defined  in 


(A. 20),  selecting  ft  = 
,  and  applying  (A. 23) 


[-ir,Tr],  wx  =  x,  w2  =  y, 
to  (A. 22),  we  obtain: 


A.  10 


f'  f  f  « •  f 

J-t r  •'—it 


y+cv+i)-2  r  y  .  r  „,+<p+i)-2  r  ,  .  r”  . 

-TT  -IT  -TT  — TT 


;  since 


-'-TT  J-7T  J-TT  ~ 

r-f  - 

J  -TT  J  -TT 


(A. 24) 


We  have  now  proved  that  (A.l)  and  (A. 2)  are  sufficient  solutions  for  the  optimiza¬ 
tion  problem  (3D) .  Those  solutions  clearly  satisfy  the  condition  for  equality  in 
expression  (9);  thus  they  are  also  sufficient  for  the  supremura  of  em(fg>  f^)  on 
F’  x  F'  ,  with  no  restrictions  on  eigenvectors. 


Part  2 

Under  the  conditions  (10)  in  the  theorem,  the  classes  F'  and  FA  „  are  non- 

s’es  N*S 

empty,  and  F's  e  d  ^  e  *  e  d.  e  *  Furthermore,  the  restrictions  through  which 
*  s  *  s  ’  N  ’  N 

the  classes  F'  and  F'  are  defined  do  not  imply  restrictions  on  the  eigenvectors 

S»  t-  W  * - 

*  s  9  N 

of  the  corresponding  spectral  density  matrices.  Therefore,  for  any  sets  (A,  (co) ;l<i<nj 

and  t^^N(w) ;l£i£n}  of  ordered  eigenfunctions,  the  eigenvectors  of  the  corresponding 

spectral  density  matrices  f_s(to)  and  f^(to)  can  be  selected  arbitrarily  for  the  supremum 

of  e  (f  ,  f  )  on  F'  x  F'  .  Let  now  f  (to)  be  some  spectral  density  matrix  in 
m  — s  “N  8,es  n»£n  ~ s 

F_  -  F*  ,  and  let  f  (<*>)  be  some  spectral  density  matrix  in  F,  -  F'  ;  where 
L,e  s,e  — N  L,e„  N,e„ 

’  s  *  s  N  *  N 

if  A  and  B  are  two  sets,  A-B  denotes  the  set  with  elements  in  A  but  not  in  B.  Let 

{A.  (to) ;  l<i<n)  and  (A.  (to);  l<i<n}  be  the  sets  of  ordered  eigenfunctions  of  the 
is  -  iN  - 

matrices  f  (to)  and  f„(to)  respectively.  Then,  for  every  i,  there  exist  A^to)  and  B^Os) 

— s  N  i  i 

subsets  of  [-tt,tt],  such  that  AJ  (to)  <  (1-e  )  A°  (to);  V  we  AJ(to)  and  A  (to)  <  (1-e  )  A°  (w) ; 

is  s  Is  i  iN  M  IN 

V  to£  B  (to) ;  where  A  (to)  and  B  (to)  are  necessarily  nonempty,  and  for  i  <  n  some  of  the 
inn 

sets  A^(w)  and  B^(to)  may  be  empty.  For  any  i  such  that  A^(to)  is  nonempty,  we  construct 

*  * 

a  new  eigenfunction  A.  (to),  such  that  A.  (to)  =  A.  (to);  V  we(  [-tkttJ-A^  (u>) ) ,  and 

is  is  is  i 


VJ. 


A. 11 


X*  (to)  =  (1-e  )  X°  (to) ;  V  to£  A  (to)  .  Similarly,  we  construct  the  new  eigenfunction 
is  s  Is  i 

X*  (to),  such  that  X*  (to)  =  X  (to) ;  V  to£  ([-tt.tt]  -  B  (w))  and  X  (to)  =  (1-e  )  X°  (to) ; 
IN  iN  IN  i  iN  h  IN 

&  A 

V  to£  B  (to) .  The  so  constructed  sets  (X,  (to);  l<i<n}  and  {XJ  (to) ;  l<i<n}  correspond 
i  is  -  iN  - 

to  spectral  density  matrices  that  are  contained  in  F*  and  F'  respectively. 

s,£s  N,£n 

In  addition,  we  have: 


e  (f  ,  O  1  (2rr) 

m  S  r* 


—  1  —1 

J-ir '  i=l  Li=l  ' 

w1 1  ([i»>]  ♦ixxH  ) 

J-TT  i=l  Li=l 


dto  < 


;  where  the  right  hand  side  of  the  double  inequality  above  is  due  to  the  fact  that 
—1  —1  — 

[x  4-  y  ]  increases  monotonically  with  increasing  x  and  y,  and  due  to  the  fact 

that  the  (X  (to) ;  l<i<n}  and  (X ,„(to) ;  l<i<n)  constructions  have  this  effect  as  compared 
is  -  iN 

to  the  sets  {X_,  (to);  l<i<n)  and  {X  (w)*  • 

is  -  iN 

Thus,  it  is  sufficicent  to  optimize  e  (f  ,  f)  on  F*  x  F’ 

’  m  — s  — N  s,£g  N,en 

Proof  of  Theorem  B 

As  in  part  2,  in  the  proof  of  theorem  A,  we  have  again  that  it  is  sufficient  to 

optimize  e  (f  ,  f„)  on  F’  x  F_.  Here,  we  will  first  show  that  the  solution  (B.l) 
m  — s  — N  8 ,  £  Q 

s 

is  sufficient  for  the  optimization  problem  (4A) .  Then,  we  will  show  that  this  solution 

is  also  sufficient  for  the  supremum  of  e  (f  ,  f  )  on  F’  x  F  . 

m  —s  — N  s,E  Q 

s 

Let  X  (to)  and  X  (to)  be  as  in  (A. 7).  Then,  for  any  admissible  sets  (X  (to)}, 
s  N  is 

(X  (to) } ,  we  have  that  (A. 21)  holds.  Thus,  (A. 21)  also  holds  if  (X.  (to)}  and 
iN  is 

{X  (to) }  are  substituted  by  (X?  (to)}  and  (X®  (to)}  in  (B.l).  For  simplicity  in  notation, 
iN  is  iN 

we  will  denote  cj  as  c^  ;  for  all  j,  and  as  in  the  proof  of  theorem  A,  we  will  prove 


IXg(w)  +  A~a(o))]"a  dw  <  l 

J  -IT  *— TT 


A*( u»  A*(u>)  [A*(u>)  +  A*(w)  ]~  do) 


Indeed,  from  the  definition  of  Xg(o>)  and  A^(w)  in  (B.1),  we  easily  obtain 

f"  f 

1  [X"1(oj)  +  X"1^)]'1  dw  -  Ae(w)  A*(o>)  [A*(o))  +  X®(w)  ]_1  doi- 

IS  N  ISNSN 

J-TT  •'-7T 


£(/ 

J-o  \ 


Xs(w)  XN(oi) 
X  (w)+X  (oj) 

S  N 


-1  C1  X1  \ 
I  -  n  ) 

y*!  / 


Applying  the  lemma  to  expression  (A. 26),  ve  obtain. 


f  -i  -i  -1 

1  [As%)  +  J  doi 

J-7T 

-  L-J  I  c  A  (w)da>  +  C  x„ 


dw  -  1  xe(w)  X®(u)  [xe(u)>  +  X“(w)]-1dw  < 

I  S  N  S  N  — 


(to)  dw 


(w)  du  n  c,+x. 


Since  X  (u>)  >  (1-e  )  X  (to)  -> 
s  —  S  Is 


yj  -  XJ°  •  yj  -  xj  - 0  ;  j:  ycj  <XJ° 


— /  k 


(A. 29) 


-1 


X  yj =  Xxj  =  n'wi 

J-O  j-o 


Now,  the  expression  in  (A.  27)  can  be  bounded  from  above  by 


-1  -2  (U+l)  c.  (y.-x) 

U  3  3  J 


which,  due  to  corollary  1  in  the  paper,  is  bounded  from  above  by: 


-1  -2  [?„  <M+1)Cj]  li  W] 

n  (y+1)  LJ=jO - J 

£  (y+Dc  +  £  (y,-x.) 

1=0  J  1=0  J  J 


(A. 30) 


Due  to  (A. 29),  the  expression  in  (A. 30)  equals  zero,  and  (A. 25)  is  now  proved.  That 

proves  that  (B.l)  is  a  sufficient  solution  for  the  optimization  problem  (4A) .  But, 

this  solution  clearly  satisfies  the  conditions  for  equality  in  (9).  Thus,  it  is  also 

sufficient  for  the  optimization  of  e  (f  ,  f„)  on  F?  x  F_. 

m  — s  — N  s,E  Q 

s 

Proof  of  Theorem  C 

As  in  the  proof  of  theorem  B,  we  will  prove  that  (A. 25)  holds,  for  the  x!(wj , 

s 

Xf!(<u)  selections  as  in  (C.l),  and  for  all  admissible  {X  (w)  ,  X„(w) }  pairs. 

N  S  N 

k 

Asin  Asj  -  0  ;  v  •  U  ASj  = 

j-i 

m 


Since, 


A. 14 


it  is  clear  that  the  km  sets  Ag^  /")  AN<  ;  i=l , . . . ,k, j=l, . . . ,m  are  mutually  exclusive 


and  exhaustive.  Thus, 


Ag(w)  XN(io)  [Ag(w)  +  A 


l'1  -  L  f 

•  J  k 


Ag(w)  AN(w)  [Ag(a))  +  An(oj)  ]“  do> 


j=l  X 


k  t  V“)d“  +f.  V“)d“  k  n-1  c  .  E  f  x  (00  du. 

EJVi _ ^sj _ sj  ^  jAgin  V  N 

f  A  (w)dw+f  A„(aj)d6D  “  -1  .A  f  .  .  . 

jA .  s  Jk .  n  j=i  n  csj  £  JA  n . 

si»  1 


A  (o))da» 

N 


Ae(w)  A*(u>)  [Ae(u»  +  A®(ta)  ]_1  da) 

s  N  s  N 


(A. 31) 


!•'  *  ;  where  the  inequality  in  (A. 31)  is  due  to  the  lemma. 

Thus,  the  inequality  (A. 25)  holds  in  this  case,  and  the  proof  is  complete,  for 

I  the  problem  (5A).  The  solution  satisfies  the  condition  for  equality  in  (9),  thus  it 

\  is  sufficient  for  the  optimization  of  e  (f  ,  f  )  on  F„  x  F  . 

m~s  -N  Qs  % 

Proof  of  Theorem  1 


Expression  (26)  is  easily  derived,  by  substitution  of  solution  (A.l)  in  theorem 
A,  in  (21). 

Let  now  condition  (12)  be  satisfied.  Then,  directly  from  solution  (A. 2)  in 
theorem  A,  and  from  the  proven  (in  the  proof  of  theorem  A)  fact  that  |i  V  <  1, 


we  have: 


55  n 


Xe(u>)+A*(u>) 

S  N 


[1+mJ 


v[l+v] 


(1_es)Xls(“)+(1~eN)XlN(a>) 


(1"es)Xls(aj) 

;  Li  :  - _<  y 

(l-eN)X^(w) 


(l-es)x°ls(a» 

;  a)  :  -  >  v 


(l-e  )Xjg(w) 

;  ui  :  y  < -  <  v 

U-e^W) 


(A. 32) 


y(i+y)' 


(1~es)xis(h)) 

a-eN)x5>) 


X®(aj) 

s 

Xe(u)+Xj(w) 

S  N 


[l+vj* 


(1~es)Xls(ai) 


a-^Ks(“)+<1-£N>xS>> 


(1-e  )X”  Cu)  . 

- L_ls - >  V-1 

(l-eN)X°N(w) 


(<W(, 

(1'en)xin<“) 


(A. 33) 


Now,  due  to  y  v  <  1,  we  have: 


v[l+vj-1  <  min  |[l+y]_1  , 


U-S)x^(u» 


<1-€s)Xls(a))+(1'"eN)  Xin(w) 


)  • 


(1-e  )X,  (.Li)  . 

;  u)  ;  y  <  - 5— -  <  v"1 

(1VX>] 


(A.  34) 


y[l+y]-1  <  min 


|[l+v]_1  , 


(1~Cs)Xls((t>) 

(l-es)X°s(u,)+(l-eN)XjN(a,) 


(1"e«)Xl8(a>)  -1 

;  Li  :  y  < - - -  <  v 

(l-eN)xiN  a) 


(A. 35) 


A.  16 


From  (A. 32),  (A. 33),  (A. 34),  and  (A. 35) ,  we  clearly  obtain. 


/  \  -1 

min  (  — — - )“  v[l+v] 

w  \A (u)+\l(u>)J 


min 

to 


(co)+A(to) 
s  N 


/  *>>  \ 

\Xe(ti))+X®(u)  / 

S  N 


(l-e  n?  ((0)  _x 

achieved  at  all  to:  -  2l  V 

(1-gn)AiN((o) 


(A. 36) 


Mll+p]  *  ;  achieved  at  all  i»): 


(l-e,)x;s(«a) 

d-e^AijjCtu) 


<  y 


(A. 37) 


Due  to  the  fact  that  the  infimum  in  (21)  is  a  linear  programming  problem,  and 
due  to  (A. 36)  and  (A. 37),  we  easily  obtain  by  substitution  the  result  in  (27). 

b. 

By  substitution  of  the  solution  (B.l)  in  theorem  B,  we  obtain: 


A®(u>) 


A>)+A*«o)  jaQ 


Vxj  "j 


V  <*> 


(A.  38) 


J 


Ae(o)) 

s 


Ae(u>)+A*(w)  .  . 

8  N  j=0 


Cj+Xj 


1A  (*) 


(A.  39) 


From  the  definition  of  the  x^'s  in  theorem  B,  and  from  (A. 38),  we  obtain: 


(  xn(u)—  ).rlt 

'  Ae(u>)+A®((o)/  l  j: 


min 

(0  '  A=(u>)+ArT(w) 

N 


/  o  - 

max  (x  c 
x°>yc  ^ 

J  J 


■>] 


-1 


(A. 40) 


£ 


Finally,  due  to  the  fact  that  the  infimum  in  (21)  is  a  linear  programming 
problem,  and  due  to  (A. 40),  we  obtain  the  result  in  (28). 


Without  lack  in  generality,  we  will  consider  the  special  solution  (C.2),  in 


/  r" 


A. 17 


theorem  C.  We  easily  find  then,  by  substitution: 


Xe(u)+A'(u) 
s  N 


[1+_ - fsl - — - j; 

cn£  y(An£^Asj)u  (An£) 


w  e  A  . 
S3 


(A. 41) 


*>> 

Xe(a))+A! 


e  "  f1  +  csj  2^  CN£  V(AN Asj5  y  (AN^  ’ 
N(a))  L  £=l  J 


u)  e  A  .  (A. 42) 

sj 


From  (A. 41),  (A. 42),  and  (21),  we  easily  find  the  expression  (29),  by  direct 


substitution. 


Proof  of  Theorem  2 

Let  us  first  consider  the  conditions  (10)  in  theorem  A,  where  W^  and  are 
given  by  (3A).  From  those  conditions,  we  directly  obtain. 


:s  >  |l  +  27r  Ws[ J  n 

![(  >  jl  +  2,  WK[jf  n 


A?  (U)  do)  -  2tt  W  1  1 
Is  os  I 


X1N(«)  dw  -  2tt 


(A. 43) 


Let  us  now  define, 


y  -  (2TT)"1  [W  +  E  [1-E  ]_1  W  J 
J  os  s  s  s 


X  =  (2ir)  1  [WoN  +  eN(l  -^r1  WN] 


f  (w)  »  n  \°  (w) 
1  Is 

f2(oj)  A  n  X°N(w) 


(A. 44) 


F(y,x)  =  /  max  (y  f^w),  x  f2(w))  do) 


Then,  the  quantities  y,  x  defined  above  are  monotonically  increasing  with  e  , 

s 


respectively,  the  conditions  (A. 43)  in  terras  of  y  and  x  become. 


ir 


>  (2ir)-2  f 

J- 7T 


nX“s (w) 


(A. 45) 


-rr 


>  (2tt)"2  f 
J-TT 


IN 


and  the  acceptable  (e  ,  e  )  region  corresponds  to, 

S  Ii 


(y,  x)  :  F(y,  x)  >  1 


(A. 46) 


From  the  expression  of  F(y,  x)  in  (A.44),  it  is  clear  that  for  the  satisfaction  of 
(A. 46),  it  is  necessary  that: 


max  max 


/  *  f2<“) i  r 

l1-  Ts^rl  ’ y  I 

J-TT 


IT 


ID 


y  f1(u) 


f^Cto)  d(D  >  1 


(A. 47) 


;  where,  due  to  conditions  (10): 


IT 


y  /  fj^w)  du)  <  1 
J-tr 


(A. 48) 


From  (A. 47)  and  (A. 48)  we  conclude  that  for  the  satisfaction  of  (A. 46)  it  is 
necessary  that: 

-1 


-  [f  (^r)][jf  fi(u)  *■] 


-  bn  (f^r)]  [  [  f2(“>  "“] 


-1 


f2(w)  du| 


(A. 49) 


A. 19 


T— t  ■  l  ■ 


For  the  satisfaction  of  both  the  conditions  (A. 45)  and  (A. 49),  we  finally 
require: 

r  -1  7t  £ 

*  n  XJs(w)da)]  *  max  g(“)»  (27T)"2  Df/n  X°s(0))d0)J  j 


(A. 50) 


IT  T 

y  ~\J  n  XiN(w)da)]  *  max  (m*n  g"1^).  W2  jf  n  X°s(w)du)J  j 

;  where  g((0)  and  D  are  given  by  (38).  The  regions  [B^  1]  and  [Bg,  1]  are  obtained 
by  substitution  of  the  y  and  x  in  (A.44),  in  the  conditions  (A.50). 

Let  us  now  define. 


G(z) 


TT 

L 


max  (z  f^oi),  f2(a>))  do) 


(A. 51) 


Then,  we  can  trivially  write. 


F(y,  x)  -  x  G  ( x  ) 


(A. 52) 


We  will  define  z  =  and  we  will  use  z  as  a  parameter.  The  breakdown  curve 
is  determined  by  the  equation 

F(y,  x)  =  1 

in  a  parametrized  form,  this  equation  becomes. 


x(z)  =  G*1  (z) 
with 

y(z)  =  z  G-1  (z) 


(A. 53) 


^  Let  us  first  study  the  function  G(z);  0  <  z  <  °°.  We  first  define. 


—i 


V*  .*  3ml  m  V*  . •..« ^JL ’ -1  —  jC» . 


and  clearly 


E.j-^E  ;  V  z,  dz  >  0 
z+dz  —  z 


(A. 55) 


-1, 


Due  to  the  conditions  satisfied  by  the  function  g(ti))  =  f^(u)  f^  (to) ,  we  have  that 


(A. 56) 


Also,  we  can  write: 


G(z)  =1  Jz  f  _  (to)  -  f  2  Cco)  duj  + 

IT 

/  f2(w)  do) 

(A. 57) 

J—Tl 

From  (A. 57),  and  due  to  (A. 55)  and  (A. 56),  we  easily  find. 


G(z)  =  Zim  G(2'f'd£~G(2?-  =  f  f,(w)  dM>0  j 
2  dz->0 

I  -/  f‘ 


V  z  >  0 


(A.  5  8) 


(oj)  do) 


C-(z)  ^  £im  ^ 


8z 


dz-K) 


dz 


>  0 


Now,  from  (A. 5 3)  we  find  in  a  straightforward  fashion: 


*lLz± 

dx(z) 

d2x(z) 


(A. 59) 


Due  to  expressions  (A. 58),  we  finally  obtain: 


A. 21 


But  z  =  0  corresponds  to  £„  =  1,  and  z  ->  00  corresponds  to  e  «  1.  Also,  y  and 

N  s 

x  are  monotonic  with  respect  to  £  and  £  respectively.  Thus,  the  conclusions  in 

s  N 

the  theorem. 


